-- Logs begin at Wed 2022-06-22 17:45:19 UTC, end at Wed 2022-06-22 19:01:48 UTC. -- Jun 22 18:29:31.683337 dv-cinder-812685-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 18:29:31.695678 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 18:29:31.698056 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 18:29:31 2022] *** Jun 22 18:29:31.698056 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 18:29:31.698056 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 18:29:31.698056 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: nodename: dv-cinder-812685-11-iscsi Jun 22 18:29:31.698056 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: machine: x86_64 Jun 22 18:29:31.698056 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: clock source: unix Jun 22 18:29:31.698056 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: pcre jit disabled Jun 22 18:29:31.698056 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: detected number of CPU cores: 4 Jun 22 18:29:31.698056 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: current working directory: / Jun 22 18:29:31.698711 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: detected binary path: /usr/bin/uwsgi-core Jun 22 18:29:31.698711 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: your processes number limit is 47680 Jun 22 18:29:31.698711 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: your memory page size is 4096 bytes Jun 22 18:29:31.698711 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: detected max file descriptor number: 2048 Jun 22 18:29:31.698711 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: lock engine: pthread robust mutexes Jun 22 18:29:31.698711 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: thunder lock: enabled Jun 22 18:29:31.698711 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 18:29:31.698711 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 18:29:31.748502 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: Python main interpreter initialized at 0x5651ddee49c0 Jun 22 18:29:31.748502 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: python threads support enabled Jun 22 18:29:31.748502 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: your server socket listen backlog is limited to 100 connections Jun 22 18:29:31.748502 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: your mercy for graceful operations on workers is 90 seconds Jun 22 18:29:31.748877 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 18:29:31.748940 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: *** Operational MODE: preforking *** Jun 22 18:29:31.749202 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: *** uWSGI is running in multiple interpreter mode *** Jun 22 18:29:31.749202 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: spawned uWSGI master process (pid: 103483) Jun 22 18:29:31.749451 dv-cinder-812685-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 18:29:31.752370 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: spawned uWSGI worker 1 (pid: 103484, cores: 1) Jun 22 18:29:31.752370 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: spawned uWSGI worker 2 (pid: 103485, cores: 1) Jun 22 18:29:31.752370 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 18:29:32.440746 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 18:29:32.450588 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 18:29:33.566018 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 18:29:33.566018 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: from cryptography.utils import int_from_bytes Jun 22 18:29:33.566622 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 18:29:33.566622 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: from cryptography.utils import int_from_bytes Jun 22 18:29:33.571497 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 18:29:33.571497 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: from cryptography.utils import int_from_bytes Jun 22 18:29:33.571952 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 18:29:33.571952 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: from cryptography.utils import int_from_bytes Jun 22 18:29:36.060774 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 18:29:36.061306 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 18:29:36.061464 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 18:29:36.061823 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 18:29:36.062078 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 18:29:36.062466 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.062788 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.063108 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.063424 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.063749 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.064085 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.064405 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.064723 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.065046 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.065305 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.065618 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.065950 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-11-iscsi {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.066259 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.066566 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.066872 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.067209 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.067633 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.068171 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.068269 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 18:29:36.068638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.068719 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 18:29:36.068973 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.069095 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 18:29:36.070118 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 18:29:36.070215 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.070295 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 18:29:36.070396 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.070476 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.070544 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.070608 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.070671 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.070735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.070806 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.070936 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.071049 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.071261 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.071392 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.071536 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.071628 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.071881 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.072034 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.072191 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.072321 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.072527 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.072614 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-11-iscsi {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.072791 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.072877 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.073110 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.073248 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.073439 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-11-iscsi {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.073535 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.073766 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.073878 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.074079 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.074177 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.074392 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.074477 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.074716 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.074801 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.075024 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.075111 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.075349 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.075440 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.075659 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.075744 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.076028 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.076199 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.076346 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.076511 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.076670 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.076820 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.076973 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.077131 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.077278 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.077471 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.077572 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.077789 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.077878 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.078102 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.078189 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.078425 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.078511 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.078698 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.078783 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.079005 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.079090 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.079320 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.079408 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.079637 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.079738 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-11-iscsi {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.080049 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.080158 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.080302 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.080398 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.080553 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.080672 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.080866 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.081089 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.081177 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.081406 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.081499 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.081721 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.081809 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.082045 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.082132 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.082345 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.082439 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.082649 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.082744 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.083095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.083564 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.083658 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.083753 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.083856 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.083938 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.084029 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.084172 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.084259 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.084480 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.084568 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.084795 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.084881 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.085110 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.085205 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.085433 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.085549 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.085744 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.085836 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.086054 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.086150 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.086297 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.086418 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.086606 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.086733 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.086932 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.087029 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.087258 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.087355 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.087583 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.087671 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.087876 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.087982 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.088117 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.088249 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.088440 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.088553 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.088763 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.088872 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.089078 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.089204 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.089390 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.089505 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.089702 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.089789 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.090012 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.090099 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.090324 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.090412 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.090635 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.090721 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.090938 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.091031 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.091239 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.091337 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.091541 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.091627 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.091852 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.091941 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.092159 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.092261 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.092461 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.092554 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.092764 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.092851 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.093065 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.093190 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.093366 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.093452 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.093663 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.093760 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.093964 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.094064 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.094266 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.094360 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.094565 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.094660 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.094878 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.095041 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.095195 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.095282 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.095499 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.095584 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.095799 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.095907 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.096134 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.096236 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.096442 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.096530 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.096757 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.096844 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.097059 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.097145 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.097362 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.097456 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.097665 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.097751 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.097964 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.098056 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.098265 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.098359 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.099389 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.099495 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.099495 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.099640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.099718 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.099795 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.100008 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.100104 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.100319 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.100405 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.100630 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.100717 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.100940 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.101031 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.101253 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.101342 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.101557 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.101659 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.101860 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.101948 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.102163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.102257 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.102466 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.102561 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.102769 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.102856 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.103073 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.103204 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.103375 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.103470 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.103672 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.103759 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.104011 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.104099 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.104323 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.104495 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.104625 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.104711 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.104927 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.105013 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.105230 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.105331 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.105535 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.105620 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.105860 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.105944 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.106169 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.106264 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.106479 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.106608 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.106801 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.106886 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.107113 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.107207 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.107424 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.107519 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.107741 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.107873 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.108068 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.108155 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.108377 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.108462 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.108695 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.108779 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.109002 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.109095 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.109310 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.109397 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.109616 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.109708 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.109926 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.110011 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.110234 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.110319 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.110543 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.110637 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.110851 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.110947 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.111160 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.111253 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.111461 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.111563 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.111766 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.111872 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.112119 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.112205 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.112432 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.112533 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.112743 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.112830 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.113046 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.113133 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.113367 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:29:36.113460 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.113706 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.113793 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.114014 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.114788 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.115271 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.115373 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.115456 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.115543 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.115623 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.115702 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.115905 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.116009 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.116216 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.116302 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.116536 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.116666 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.116858 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.116945 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.117165 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.117266 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.117480 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.117567 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.117787 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.117875 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.118095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.118182 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.118402 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.118489 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.118710 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.118797 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.119017 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.119104 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.119347 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.119433 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.119658 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.119745 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.119994 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.120083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.120304 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.120408 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.120617 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.120703 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.120925 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.121058 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.121231 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.121327 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.121537 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.121622 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.121837 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.121923 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.122137 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.122232 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.122437 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.122523 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.122741 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.122834 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.123040 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.123137 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.123352 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.123438 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.123672 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.123757 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.123997 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.124087 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.124325 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.124421 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.124626 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.124720 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.124930 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.125018 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.125236 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.125323 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.125541 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.125635 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.125841 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.125928 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.126147 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.126240 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.126452 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.126546 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.126744 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.126841 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.127062 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.127158 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.127368 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.127464 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.127667 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.127754 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.128274 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.128361 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.128577 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.128673 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.128879 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.128976 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.129192 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.129279 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.129500 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.129599 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.129863 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.130296 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.130418 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.130552 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.130637 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.130725 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.130811 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.130892 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.131053 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.131146 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.131363 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.131451 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.131695 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.131780 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.132032 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.132133 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.132338 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.132432 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.132660 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.132749 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.132972 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.133067 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.133281 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.133368 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.133580 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.133679 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.133887 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.133973 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.134185 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.134279 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.134485 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.134573 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.134785 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.134881 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.135088 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.135174 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.135385 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.135461 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.135685 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.135779 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.136009 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.136099 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.136308 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.136395 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.136612 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.136708 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.136929 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.137016 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.137233 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.137319 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.137531 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.137632 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.137829 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.137924 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.138129 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.138215 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.138457 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.138550 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.138755 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.138840 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.139077 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.139162 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.139406 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.139492 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.139718 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.139805 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.140059 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.140145 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.140366 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.140459 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.140676 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.140764 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.140980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.141074 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.141285 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.141372 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.141591 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.141684 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.141895 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.141991 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.142200 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.142285 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.142505 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.142589 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.142815 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.142910 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.143118 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.143203 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.143421 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.143506 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.143728 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.143825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.144057 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.144143 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.144355 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.144440 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.144665 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.144763 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.144976 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.145062 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.145284 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.145370 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.145807 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.145907 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.145989 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.146091 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.146278 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.146441 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.146593 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.146754 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.146891 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.147100 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.147186 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.147440 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.147529 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.147763 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.147952 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.148105 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.148203 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.148411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.148507 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.148723 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.148820 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.149031 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.149117 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.149347 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.149442 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.149650 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.149735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.149962 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.150056 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.150262 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.150350 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.150570 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.150664 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.150891 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.150986 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.151210 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.151336 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.151515 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.151612 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.151823 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.151928 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.152160 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.152248 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.152466 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.152552 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.152769 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.152855 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.153075 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.153170 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.153376 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.153463 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.153677 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.153777 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.153982 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.154070 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.154292 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.154387 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.154597 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.154692 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.154901 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.154988 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.155200 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.155286 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.155512 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.155678 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.155816 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.155952 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.156139 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.156227 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.156439 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.156536 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.156751 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.156845 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.157069 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.157164 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.157372 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.157466 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.157688 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.157775 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.158005 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.158089 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.158303 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.158396 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.158604 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.158691 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.158921 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.159007 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.159226 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.159312 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.159525 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.159618 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.159826 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.159934 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.160145 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.160233 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.160482 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.160568 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.160788 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.160883 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.161639 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.162122 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.162212 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.162292 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.162379 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.162467 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.162578 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.162698 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.162890 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.163022 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.163198 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.163339 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.163505 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.163653 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.163824 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.163987 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.164156 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.164296 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.164461 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.164612 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.164770 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.164923 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.165077 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.165233 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.165385 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.165549 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.165692 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.165876 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.166010 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.166192 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.166315 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.166520 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.166607 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.166848 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.166948 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.167161 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.167251 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.167472 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.167559 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.167801 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.167990 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.168140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.168403 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.168498 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.168735 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.168947 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.169251 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.169339 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.169570 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.169666 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.169891 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.169987 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.170207 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.170296 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.170532 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.170617 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.170857 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.170952 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.171175 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.171263 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.171493 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.171629 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.171805 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.171945 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.172135 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.172239 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.172437 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.172526 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.172748 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.172835 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.173053 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.173143 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.173358 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.173444 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.173660 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.173746 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.173965 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.174268 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.174355 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.174571 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.174657 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.174870 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.174971 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.175170 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.175256 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.175482 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.175578 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.175781 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.175888 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.176115 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.176216 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.176417 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.176515 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.177900 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.178023 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.178107 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.178186 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.178265 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.178353 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.178433 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.178519 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.178712 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.178919 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.179051 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.179354 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.179510 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.179690 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.180050 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.180153 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.180390 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.180693 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.180783 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.180996 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.181315 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.181411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.181615 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.181910 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.182002 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.182210 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.182495 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.182589 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.182804 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.183059 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.183154 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.183396 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.183645 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.183733 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.184017 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.184298 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.184387 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.184608 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.184796 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.184911 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.185130 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.185226 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.185455 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.185543 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.185784 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.185983 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.186104 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.186284 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.186425 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.186585 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.186744 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.186890 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.187193 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.187280 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.187492 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.187797 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.187941 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.188123 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.188434 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.188521 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.188733 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.189034 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.189119 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.189384 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.189525 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.189729 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.189815 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.190057 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.190144 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.190379 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.190467 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.190698 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.190784 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.191013 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.191099 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.191316 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.191404 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.191616 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.191710 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.192037 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.192129 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.192418 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.192806 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.192806 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.192952 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.193042 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.193122 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.193350 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.193440 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.193665 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.193752 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.193980 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.194155 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.194293 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.194464 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.194692 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.194786 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.195053 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.195284 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.195374 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.195646 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.195897 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.195999 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.196271 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.196485 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.196573 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.196859 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.197084 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.197170 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.197465 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.197674 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.197765 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.198075 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.198249 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.198402 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.198555 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.198723 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.198856 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.199046 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.199194 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.199362 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.199494 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.199720 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.199869 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.200179 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.200303 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.200684 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.200839 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.201001 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.201308 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.201394 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.201614 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.201890 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.201985 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.202208 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.202410 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.202518 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.202823 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.202918 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.203130 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.203406 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.203493 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.203715 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.203924 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.204062 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.204371 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.204464 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.204678 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.204908 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.204994 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.205299 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.205386 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.205618 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.205862 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.205948 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.206209 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.206357 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.206515 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.206820 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.206907 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.207124 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.207323 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.207430 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.207736 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.207929 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.208395 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.208563 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.208660 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.208846 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.208974 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.209291 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.209384 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.209598 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.209812 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.209899 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.210197 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.210284 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.210499 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.210765 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.210860 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.211111 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.211258 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.211410 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.211712 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.211806 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.212040 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.212296 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.212382 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.212632 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.212782 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.213064 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.213282 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.213419 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.213671 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.213757 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.213973 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.214238 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.214335 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.214572 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.214723 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.214884 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.215174 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.215281 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.215482 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.215576 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.215798 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.215914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.216140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.216237 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.216456 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.216546 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.216770 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.216856 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.217088 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.217175 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.217391 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.217480 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.217699 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.217830 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.218011 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.218098 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.218311 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.218397 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.218613 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.218700 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.218914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.219001 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.219237 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.219324 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.219538 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.219633 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.219870 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.219961 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.220267 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.220352 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.220581 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.220676 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.220885 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.220979 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.221203 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.221291 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.221520 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.221621 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.221840 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.221927 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.222158 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.222253 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.222475 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.222575 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.222787 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.222874 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.223087 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.223179 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.223397 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.224416 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.224416 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.224678 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.224794 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.224910 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.225038 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.225155 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.225286 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.225412 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.225532 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.225649 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.225788 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.225877 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.226093 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.226181 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.226410 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.226495 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.226718 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.226806 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.227030 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.227157 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.227344 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.227479 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.227661 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.227796 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.228011 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.228104 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.228300 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.228401 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.228616 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.228702 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.228931 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.229026 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.229244 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.229384 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.229555 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.229703 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.229854 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.229984 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.230156 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.230289 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.230472 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.230560 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.230774 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.230860 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.231077 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.231164 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.231382 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.231490 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.231691 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.231818 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.232043 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.232214 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.232340 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.232508 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.232603 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.232743 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.232892 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.233059 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.233211 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.233374 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.233521 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.233683 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.233840 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.233999 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.234158 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.234313 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.234458 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.234632 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.234775 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.234948 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.235082 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.235254 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.235382 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.235675 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.235761 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.236011 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.236113 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.236327 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.236405 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.236638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.236723 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.236944 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.237031 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.237254 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.237342 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.237570 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.237666 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.237873 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.237961 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.238193 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.238288 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.238503 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.238590 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.238811 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.238897 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.239705 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.240287 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.240287 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.240448 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.240538 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.240618 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.240704 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.240835 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.240976 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.241153 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.241249 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.241463 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.241558 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.241810 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.241895 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.242114 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.242210 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.242416 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.242511 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.242717 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.242804 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.243016 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.243112 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.243335 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.243423 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.243636 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.243741 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.243981 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.244072 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.244289 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.244417 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.244590 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.244691 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.244891 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.244979 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.245190 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.245285 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.245528 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.245625 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.245828 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.245915 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.246160 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.246259 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.246478 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.246575 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.246796 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.246884 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.247117 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.247203 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.247421 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.247542 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.247742 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.247900 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.248081 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.248197 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.248397 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.248525 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.248712 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.248856 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.249027 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.249165 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.249340 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.249474 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.249660 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.249789 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.249973 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.250101 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.250279 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.250410 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.250593 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.250737 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.250906 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.251045 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.251220 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.251359 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.251678 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.251764 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.252017 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.252117 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.252326 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.252413 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.252633 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.252719 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.253222 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.253319 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.253530 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.253625 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.253855 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.253942 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.254168 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.254262 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.254478 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.254573 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.254817 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.255407 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.255510 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.255593 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.255672 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.255806 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.255915 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.255995 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.256089 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.256170 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.256396 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.256484 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.256709 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.256797 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.257019 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.257109 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.257329 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.257416 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.257639 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.257739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.257990 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.258083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.258302 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.258389 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.258604 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.258700 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.258913 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.259009 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.259224 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.259320 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.259534 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.259631 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.259870 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.260003 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.260184 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.260288 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.260494 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.260583 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.260801 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.260890 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.261108 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.261204 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.261414 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.261511 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.261725 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.261815 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.262031 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.262117 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.262342 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.262437 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.262651 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.262777 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.262959 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.263061 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.263265 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.263352 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.263574 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.263667 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.263908 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.264081 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.264234 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.264419 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.264548 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.264729 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.264855 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.265057 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.265159 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.265377 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.265465 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.265694 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.265782 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.266008 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.266104 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.266320 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.266408 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.266640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.266737 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.266942 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.267029 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.267243 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.267331 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.267549 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.267645 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.267869 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.267996 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.268175 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.268320 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.268491 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.268642 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.268798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.268962 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.269097 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.269282 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.269411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.269601 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.269723 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.269922 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.270242 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.270728 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.271861 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.271954 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.272035 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.272113 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.272205 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.272287 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.272438 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.272521 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.272521 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.272650 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.272729 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.272807 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.272887 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.272955 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.273040 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.273126 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.273212 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.273328 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.273506 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.273647 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.273814 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.273967 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.274117 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.274286 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.274417 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.274605 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.274735 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.274922 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.275018 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.275237 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.275327 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.275572 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.275660 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.275908 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.275999 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.276232 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.276321 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.276536 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.276623 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.276840 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.276935 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.277141 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.277232 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.277448 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.277536 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.277749 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.277846 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.278050 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.278138 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.278351 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.278492 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.278650 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.278750 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.278961 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.279048 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.279262 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.279350 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.279574 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.279662 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.279895 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.279987 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.280206 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.280295 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.280507 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.280603 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.280813 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.280900 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.281166 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.281253 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.281487 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.281575 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.281788 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.281874 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.282088 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.282182 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.282401 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.282496 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.282709 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.282796 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.283027 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.283122 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.283338 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.283425 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.283647 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.283734 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.283987 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.284090 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.284315 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.284507 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.284825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.284911 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.285150 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.285245 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.285470 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.285558 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.285795 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.285881 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.286653 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.287104 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.287104 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.287257 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.287257 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.287401 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.287565 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.287683 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.287905 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.288031 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.288222 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.288341 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.288535 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.288633 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.288842 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.288929 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.289167 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.289262 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.289480 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.289576 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.289789 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.289876 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.290111 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.290212 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.290417 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.290504 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.290723 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.290944 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.291039 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.291296 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.291385 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.291613 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.291699 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.291943 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.292046 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.292255 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.292344 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.292592 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.292679 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.292901 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.293000 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.293212 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.293305 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.293522 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.293608 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.293829 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.293929 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.294132 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.294220 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.294439 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.294525 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.294741 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.294835 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.295046 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.295132 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.295355 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.295446 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.295667 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.295767 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.295998 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.296086 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.296300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.296397 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.296607 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.296715 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.296935 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.297022 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.297244 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.297332 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.297552 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.297651 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.297858 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.297945 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.298172 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.298259 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.298481 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.298569 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.298788 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.299097 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.299238 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.299404 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.299491 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.299721 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.299816 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.300052 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.300154 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.300364 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.300460 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.300671 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.300758 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.300984 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.301152 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.301283 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.301370 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.302139 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.302645 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.302735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.302826 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.302896 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.303039 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.303127 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.303347 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.303444 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.303648 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.303736 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.303974 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.304077 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.304282 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.304379 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.304583 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.304671 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.304886 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.304973 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.305187 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.305283 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.305486 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.305575 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.305792 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.306090 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.306184 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.306390 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.306479 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.306688 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.306776 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.306986 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.307082 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.307284 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.307373 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.307582 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.307670 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.307907 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.308011 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.308208 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.308297 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.308509 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.308597 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.308809 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.308909 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.309110 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.309198 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.309409 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.309496 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.309736 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.309832 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.310066 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.310154 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.310384 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.310473 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.310695 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.310828 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.311000 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.311087 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.311308 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.311396 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.311611 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.311700 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.311949 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.312038 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.312267 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.312353 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.312576 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.312664 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.312879 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.313010 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.313206 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.313347 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.313513 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.313601 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.313820 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.313916 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.314128 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.314229 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.314433 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.314521 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.314740 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.314845 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.315045 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.315142 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.315356 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.315442 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.315669 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.315756 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.315995 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.316095 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.316317 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.316406 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.316632 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.316719 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.316944 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.317033 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.317409 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.317828 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.317938 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.318020 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.318136 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.318260 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.318466 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.318553 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.318784 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.318870 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.319110 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.319206 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.319437 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.319524 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.319750 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.319876 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.320092 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.320180 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.320405 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.320491 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.320725 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.320825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.321050 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.321138 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.321361 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.321447 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.321686 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.321781 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.321995 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.322082 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.322310 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.322397 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.322619 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.322707 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.322932 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.323033 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.323255 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.323343 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.323567 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.323653 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.323892 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.323981 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.324197 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.324284 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.324440 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 18:29:36.324529 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.324804 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.325114 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.325425 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.325732 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.326044 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.326351 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.326660 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.326966 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.327275 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.327583 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.327911 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.328227 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.328534 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.328843 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.329148 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.329456 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.329762 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.330096 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.330434 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.330754 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.331080 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.331394 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.331719 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.332057 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.332387 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.332713 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.333132 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.333571 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.333902 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.334221 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.334540 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.334857 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.335174 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.335489 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.335804 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.336158 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.336491 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.336804 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.337135 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.337458 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.337782 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.338102 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.338418 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.338751 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.339068 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.339381 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.339702 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.340039 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.340356 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.340676 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.340997 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.341326 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.341656 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.341973 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.342309 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.342638 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.342990 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.343311 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.343659 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.344017 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.344337 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.344654 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.344962 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:29:36.345210 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 18:29:36.409958 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO dbcounter [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] Registered counter for database nova_api Jun 22 18:29:36.477534 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO dbcounter [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Registered counter for database nova_api Jun 22 18:29:36.499395 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_db.sqlalchemy.engines [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:29:36.506839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writer thread running {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:29:36.527087 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG oslo_db.sqlalchemy.engines [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:29:36.534362 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG dbcounter [-] [103484] Writer thread running {{(pid=103484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:29:36.565458 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.context [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a31ed574-36eb-4581-9846-6247202b74dc(cell1) {{(pid=103485) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 18:29:36.569391 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:29:36.570966 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:29:36.571763 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:29:36.573716 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:29:36.575675 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO dbcounter [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Registered counter for database nova_cell0 Jun 22 18:29:36.579659 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO dbcounter [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Registered counter for database nova_cell1 Jun 22 18:29:36.587062 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_db.sqlalchemy.engines [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:29:36.591674 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writer thread running {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:29:36.592345 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_db.sqlalchemy.engines [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:29:36.592659 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.context [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a31ed574-36eb-4581-9846-6247202b74dc(cell1) {{(pid=103484) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 18:29:36.596691 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG oslo_concurrency.lockutils [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:29:36.598280 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG oslo_concurrency.lockutils [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:29:36.599773 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG oslo_concurrency.lockutils [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:29:36.601962 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG oslo_concurrency.lockutils [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:29:36.603965 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO dbcounter [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] Registered counter for database nova_cell0 Jun 22 18:29:36.607779 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO dbcounter [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] Registered counter for database nova_cell1 Jun 22 18:29:36.615247 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG oslo_db.sqlalchemy.engines [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:29:36.618461 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG oslo_db.sqlalchemy.engines [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:29:36.621763 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG dbcounter [-] [103484] Writer thread running {{(pid=103484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:29:36.734038 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writer thread running {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:29:36.742946 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO dbcounter [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Registered counter for database nova_cell0 Jun 22 18:29:36.751787 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_db.sqlalchemy.engines [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:29:36.757257 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writer thread running {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:29:36.766856 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG dbcounter [-] [103484] Writer thread running {{(pid=103484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:29:36.777406 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO dbcounter [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] Registered counter for database nova_cell0 Jun 22 18:29:36.784833 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG oslo_db.sqlalchemy.engines [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:29:36.790261 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG dbcounter [-] [103484] Writer thread running {{(pid=103484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:29:37.112707 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: WARNING keystonemiddleware.auth_token [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 18:29:37.120888 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: WARNING keystonemiddleware.auth_token [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 18:29:37.122713 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: WARNING keystonemiddleware.auth_token [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 18:29:37.132882 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: WARNING keystonemiddleware.auth_token [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 18:29:37.477744 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: WARNING keystonemiddleware.auth_token [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 18:29:37.484716 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: WARNING keystonemiddleware.auth_token [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 18:29:37.491332 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651ddee49c0 pid: 103485 (default app) Jun 22 18:29:37.493509 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:29:37.494713 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001821 Jun 22 18:29:37.495127 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Wed Jun 22 18:29:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:29:37.495609 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: WARNING keystonemiddleware.auth_token [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 18:29:37.501642 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: WARNING keystonemiddleware.auth_token [None req-28720e80-3436-4efd-81d2-679d2f590896 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 18:29:37.507859 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651ddee49c0 pid: 103484 (default app) Jun 22 18:30:53.952284 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:30:53.954677 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002918 Jun 22 18:30:53.955142 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:30:53 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:30:53.971042 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG dbcounter [-] [103484] Writing DB stats nova_api:SELECT=3 {{(pid=103484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:53.972376 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG dbcounter [-] [103484] Writing DB stats nova_cell0:SELECT=3 {{(pid=103484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:53.973975 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG dbcounter [-] [103484] Writing DB stats nova_cell1:SELECT=3 {{(pid=103484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:53.974915 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG dbcounter [-] [103484] Writing DB stats nova_cell0:SELECT=3 {{(pid=103484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:54.442390 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-3260d746-fa7e-4946-b5db-6ab288551001 admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:30:54.473159 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-3260d746-fa7e-4946-b5db-6ab288551001 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.509386 Jun 22 18:30:54.473696 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jun 22 18:30:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:30:56.563998 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:30:56.564987 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-3faabecc-b776-4e99-b699-3cd67577b67e None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jun 22 18:30:56.565471 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:30:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:30:56.627331 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-390fc2c0-64c7-4e6e-98a1-ce0357ca1cca admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:30:56.646490 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:30:56.646490 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: warnings.warn(msg) Jun 22 18:30:56.676446 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-390fc2c0-64c7-4e6e-98a1-ce0357ca1cca admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104935 Jun 22 18:30:56.677185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 18:30:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:30:56.690829 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writing DB stats nova_api:SELECT=3 {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:56.691782 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writing DB stats nova_cell0:SELECT=3 {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:56.692809 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writing DB stats nova_cell1:SELECT=3 {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:56.693733 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:30:56.905651 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-0e06e893-11c1-4e38-83fb-84bfc378b591 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:30:56.908895 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:30:56.908895 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: warnings.warn(msg) Jun 22 18:30:56.976249 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-0e06e893-11c1-4e38-83fb-84bfc378b591 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290962 Jun 22 18:30:56.977044 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 22 18:30:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:30:59.057997 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-390fc2c0-64c7-4e6e-98a1-ce0357ca1cca admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:30:59.059015 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-390fc2c0-64c7-4e6e-98a1-ce0357ca1cca admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 22 18:30:59.059893 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:30:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:30:59.174125 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-4a385166-8a7e-4c09-9aea-e3b86e4fd6f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "swap": 0, "name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:30:59.193332 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:30:59.193332 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: warnings.warn(msg) Jun 22 18:30:59.211572 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-4a385166-8a7e-4c09-9aea-e3b86e4fd6f5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144942 Jun 22 18:30:59.212161 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 18:30:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:30:59.224553 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-cdb36561-8131-4c65-9950-fade45b05b77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:30:59.226137 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:30:59.226137 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: warnings.warn(msg) Jun 22 18:30:59.259476 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-cdb36561-8131-4c65-9950-fade45b05b77 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038659 Jun 22 18:30:59.260089 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 22 18:30:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:31:01.382260 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-4a385166-8a7e-4c09-9aea-e3b86e4fd6f5 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:01.383466 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-4a385166-8a7e-4c09-9aea-e3b86e4fd6f5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Jun 22 18:31:01.384001 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:31:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:01.449805 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-f0fa39fd-bba3-4611-bf66-648f60334c07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2", "disk": 10, "ram": 1024, "name": "ds1G", "vcpus": 1}} {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:01.470363 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-f0fa39fd-bba3-4611-bf66-648f60334c07 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079576 Jun 22 18:31:01.472388 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 18:31:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:31:01.483702 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-de5ed046-b63b-44c3-9970-7b31ea0b87f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:01.510003 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-de5ed046-b63b-44c3-9970-7b31ea0b87f5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030584 Jun 22 18:31:01.510716 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 22 18:31:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:31:03.665535 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-f0fa39fd-bba3-4611-bf66-648f60334c07 admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:03.666553 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-f0fa39fd-bba3-4611-bf66-648f60334c07 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 22 18:31:03.666948 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:31:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:03.727220 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-9a987e0a-6847-4b2a-aafd-e776fb6de7b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:03.744186 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-9a987e0a-6847-4b2a-aafd-e776fb6de7b7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071137 Jun 22 18:31:03.744731 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 18:31:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:31:03.757628 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-0fdba48e-9dcd-4ad1-9dd9-68a0eb639c60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:03.781268 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-0fdba48e-9dcd-4ad1-9dd9-68a0eb639c60 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027239 Jun 22 18:31:03.781928 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 22 18:31:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:31:05.893223 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-9a987e0a-6847-4b2a-aafd-e776fb6de7b7 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:05.894233 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-9a987e0a-6847-4b2a-aafd-e776fb6de7b7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 22 18:31:05.894629 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:31:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:05.951546 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-f68980f6-ff25-46d0-bf9e-e0fc0a86b9b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:05.970031 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-f68980f6-ff25-46d0-bf9e-e0fc0a86b9b4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069716 Jun 22 18:31:05.970578 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 18:31:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 18:31:05.982857 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-ab6d3a09-63a6-4307-8765-1a73501d1fd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:06.005292 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-ab6d3a09-63a6-4307-8765-1a73501d1fd8 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026069 Jun 22 18:31:06.006113 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 22 18:31:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:31:08.098843 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-f68980f6-ff25-46d0-bf9e-e0fc0a86b9b4 admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:08.099892 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-f68980f6-ff25-46d0-bf9e-e0fc0a86b9b4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 22 18:31:08.100289 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:31:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:08.162422 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-584c49f7-7073-4029-909b-f3579810fa31 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:08.186608 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-584c49f7-7073-4029-909b-f3579810fa31 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080363 Jun 22 18:31:08.187305 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jun 22 18:31:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:31:10.355944 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-f68980f6-ff25-46d0-bf9e-e0fc0a86b9b4 admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:10.356955 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-f68980f6-ff25-46d0-bf9e-e0fc0a86b9b4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 22 18:31:10.357548 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:31:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:10.418801 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-14bd9dca-6a45-4688-b43d-0a261ae84c7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1"}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:10.438506 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-14bd9dca-6a45-4688-b43d-0a261ae84c7e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073906 Jun 22 18:31:10.439049 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 18:31:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:31:10.450935 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-aaf64853-1f55-41c2-a6ca-43e3e22a7775 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:10.476895 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-aaf64853-1f55-41c2-a6ca-43e3e22a7775 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029496 Jun 22 18:31:10.477608 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 22 18:31:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:31:12.550000 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-14bd9dca-6a45-4688-b43d-0a261ae84c7e admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:12.551131 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-14bd9dca-6a45-4688-b43d-0a261ae84c7e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Jun 22 18:31:12.551616 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:31:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:31:12.621425 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-8868eb0e-772f-4b72-bac2-adf4f57c4bae admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1, "swap": 0}} {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:12.640426 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-8868eb0e-772f-4b72-bac2-adf4f57c4bae admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082764 Jun 22 18:31:12.642166 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 18:31:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 18:31:12.654932 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-61840a96-f406-483c-a13e-27757147f965 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:12.681220 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-61840a96-f406-483c-a13e-27757147f965 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030409 Jun 22 18:31:12.682081 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 22 18:31:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:31:14.814885 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-8868eb0e-772f-4b72-bac2-adf4f57c4bae admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:14.816027 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-8868eb0e-772f-4b72-bac2-adf4f57c4bae admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Jun 22 18:31:14.816423 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:31:14.878794 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-17934f83-0e02-431d-a73d-2ec1eece97e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "vcpus": 2, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:14.898570 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-17934f83-0e02-431d-a73d-2ec1eece97e7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074569 Jun 22 18:31:14.899276 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 18:31:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:31:14.912107 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-9ce0bbf5-90fa-4ce2-9593-33304b9591e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:14.938657 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-9ce0bbf5-90fa-4ce2-9593-33304b9591e3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030294 Jun 22 18:31:14.939320 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 22 18:31:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:31:17.145261 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-17934f83-0e02-431d-a73d-2ec1eece97e7 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:17.146269 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-17934f83-0e02-431d-a73d-2ec1eece97e7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 22 18:31:17.146668 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:31:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:17.205027 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-2edb6bac-b239-4c64-874b-61991a71c098 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "name": "m1.large", "id": "4", "swap": 0, "disk": 80}} {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:17.224647 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-2edb6bac-b239-4c64-874b-61991a71c098 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072176 Jun 22 18:31:17.225181 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 18:31:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 18:31:17.237599 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-e1bbf96c-3948-425e-a3e1-71b9a2680035 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:17.262458 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-e1bbf96c-3948-425e-a3e1-71b9a2680035 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029104 Jun 22 18:31:17.263008 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 22 18:31:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:31:19.329038 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-2edb6bac-b239-4c64-874b-61991a71c098 admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:19.330052 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-2edb6bac-b239-4c64-874b-61991a71c098 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002135 Jun 22 18:31:19.330745 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:19.394016 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-7c0dd9d7-3c10-49d1-bd17-808ea5eda7f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "id": "5", "name": "m1.xlarge"}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:19.413966 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-7c0dd9d7-3c10-49d1-bd17-808ea5eda7f6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077593 Jun 22 18:31:19.414528 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 22 18:31:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 18:31:19.426318 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-8f9927f8-0b57-4aed-9912-5da6779f5cd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:19.449696 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-8f9927f8-0b57-4aed-9912-5da6779f5cd2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027034 Jun 22 18:31:19.467954 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 22 18:31:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:31:44.391311 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-7c0dd9d7-3c10-49d1-bd17-808ea5eda7f6 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:44.393386 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-7c0dd9d7-3c10-49d1-bd17-808ea5eda7f6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jun 22 18:31:44.393787 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:31:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:44.403974 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG dbcounter [-] [103484] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:31:44.453973 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-42ad4283-80cd-43db-89c0-8f61171cadaf admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:44.471627 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-42ad4283-80cd-43db-89c0-8f61171cadaf admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072162 Jun 22 18:31:44.472125 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jun 22 18:31:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:31:45.388974 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-7c0dd9d7-3c10-49d1-bd17-808ea5eda7f6 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:45.389967 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-7c0dd9d7-3c10-49d1-bd17-808ea5eda7f6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jun 22 18:31:45.390361 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 18:31:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:45.582202 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-3883ab5a-b7f8-49aa-8a83-560262c68908 admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:45.587826 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.wsgi [None req-3883ab5a-b7f8-49aa-8a83-560262c68908 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-3883ab5a-b7f8-49aa-8a83-560262c68908 admin admin] Request method failure captured: Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Accept: application/json Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Accept-Encoding: gzip, deflate Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Connection: keep-alive Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Content-Length: 0 Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Host: 10.222.0.18 Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Openstack-Api-Version: compute 2.90 Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Openstack-System-Scope: None Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: User-Agent: python-novaclient Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Auth-Token: gAAAAABis2AR73luR4_dwigKmlWoj2v0J7oLOKIk7clmS0-T3i1MT6DmGgQgwJRUlVO8FTzyCGBvrdDvPGlbBWHyOck4i236EmUKbfeT8nGnBxbLY11tmKF5A2Yv9pz0ADqKzyXnhFBAEXAx6nhlFuioSgI0ZDTNa6HufxBlUWkpk-9ZqII3plk Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Domain-Id: None Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Domain-Name: None Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Identity-Status: Confirmed Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Is-Admin-Project: True Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Project-Domain-Id: default Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Project-Domain-Name: Default Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Project-Id: 5555f070d6fd48a3923494f663482206 Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Project-Name: admin Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Role: member,reader,admin Jun 22 18:31:45.591185 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Roles: member,reader,admin Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5555f070d6fd48a3923494f663482206", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5555f070d6fd48a3923494f663482206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5555f070d6fd48a3923494f663482206"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5555f070d6fd48a3923494f663482206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Tenant: admin Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Tenant-Id: 5555f070d6fd48a3923494f663482206 Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Tenant-Name: admin Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User: admin Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User-Domain-Id: default Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User-Domain-Name: Default Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User-Id: 2a54999c7536405a8d0c6aa5dc9fba82 Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User-Name: admin Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: method: > Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: exception: Flavor 42 could not be found. Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: action_args: {'id': '42'} Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:31:45.592735 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:31:45.593582 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:45.594739 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-3883ab5a-b7f8-49aa-8a83-560262c68908 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:31:45.597723 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-3883ab5a-b7f8-49aa-8a83-560262c68908 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064537 Jun 22 18:31:45.597723 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jun 22 18:31:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:45.604040 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-72d414c4-ac35-4cc1-a398-c11f490a2d0f admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:45.607826 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:31:45.628767 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-72d414c4-ac35-4cc1-a398-c11f490a2d0f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029019 Jun 22 18:31:45.629330 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 22 18:31:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:31:45.639422 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-266b3e62-f71b-4aac-affe-aeb5f80a8675 admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:45.660850 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-266b3e62-f71b-4aac-affe-aeb5f80a8675 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025133 Jun 22 18:31:45.661376 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 22 18:31:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:31:45.671518 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-d7e3a20f-a805-4bad-9b03-5f589e72c37e admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:45.678813 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.wsgi [None req-d7e3a20f-a805-4bad-9b03-5f589e72c37e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-d7e3a20f-a805-4bad-9b03-5f589e72c37e admin admin] Request method failure captured: Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Accept: application/json Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Accept-Encoding: gzip, deflate Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Connection: keep-alive Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Content-Length: 0 Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Host: 10.222.0.18 Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Openstack-Api-Version: compute 2.90 Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Openstack-System-Scope: None Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: User-Agent: python-novaclient Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Auth-Token: gAAAAABis2AR73luR4_dwigKmlWoj2v0J7oLOKIk7clmS0-T3i1MT6DmGgQgwJRUlVO8FTzyCGBvrdDvPGlbBWHyOck4i236EmUKbfeT8nGnBxbLY11tmKF5A2Yv9pz0ADqKzyXnhFBAEXAx6nhlFuioSgI0ZDTNa6HufxBlUWkpk-9ZqII3plk Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Domain-Id: None Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Domain-Name: None Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Identity-Status: Confirmed Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Is-Admin-Project: True Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Project-Domain-Id: default Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Project-Domain-Name: Default Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Project-Id: 5555f070d6fd48a3923494f663482206 Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Project-Name: admin Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Role: member,reader,admin Jun 22 18:31:45.682095 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Roles: member,reader,admin Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5555f070d6fd48a3923494f663482206", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5555f070d6fd48a3923494f663482206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5555f070d6fd48a3923494f663482206"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5555f070d6fd48a3923494f663482206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Tenant: admin Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Tenant-Id: 5555f070d6fd48a3923494f663482206 Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Tenant-Name: admin Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User: admin Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User-Domain-Id: default Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User-Domain-Name: Default Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User-Id: 2a54999c7536405a8d0c6aa5dc9fba82 Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User-Name: admin Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: method: > Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: exception: Flavor 42 could not be found. Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: action_args: {'id': '42'} Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:31:45.683638 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:31:45.684640 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:45.685798 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-d7e3a20f-a805-4bad-9b03-5f589e72c37e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:31:45.686811 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-d7e3a20f-a805-4bad-9b03-5f589e72c37e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016428 Jun 22 18:31:45.686811 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jun 22 18:31:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 22 18:31:46.495320 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-266b3e62-f71b-4aac-affe-aeb5f80a8675 admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:46.496350 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-266b3e62-f71b-4aac-affe-aeb5f80a8675 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 22 18:31:46.496744 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 18:31:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:46.686248 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-5794692d-f349-458f-87d4-eeb4191c9c01 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:46.693890 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.wsgi [None req-5794692d-f349-458f-87d4-eeb4191c9c01 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-5794692d-f349-458f-87d4-eeb4191c9c01 admin admin] Request method failure captured: Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Accept: application/json Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Accept-Encoding: gzip, deflate Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Connection: keep-alive Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Content-Length: 0 Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Host: 10.222.0.18 Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Openstack-Api-Version: compute 2.90 Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Openstack-System-Scope: None Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: User-Agent: python-novaclient Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Auth-Token: gAAAAABis2ASrYJ5tCujPGmHCdCzczrNEsNsaeNXJKVJAQEpTt8A5OHXoz0csIeISAx2wRpENPk4RjFG_roKeXiQzh1Ry0XOGpjL297Gr4iFlWd-sFa_xKk_GjWlPG6tB-KceV8EIxNvi-jYA1LNvOKXiaR7gmsXW4M26ZY_H_cy9w49PEl4n-g Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Domain-Id: None Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Domain-Name: None Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Identity-Status: Confirmed Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Is-Admin-Project: True Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Project-Domain-Id: default Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Project-Domain-Name: Default Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Project-Id: 5555f070d6fd48a3923494f663482206 Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Project-Name: admin Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Role: member,reader,admin Jun 22 18:31:46.695393 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Roles: member,reader,admin Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5555f070d6fd48a3923494f663482206", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5555f070d6fd48a3923494f663482206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5555f070d6fd48a3923494f663482206"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5555f070d6fd48a3923494f663482206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Tenant: admin Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Tenant-Id: 5555f070d6fd48a3923494f663482206 Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Tenant-Name: admin Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User: admin Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User-Domain-Id: default Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User-Domain-Name: Default Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User-Id: 2a54999c7536405a8d0c6aa5dc9fba82 Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User-Name: admin Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: method: > Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: exception: Flavor 84 could not be found. Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: action_args: {'id': '84'} Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:31:46.696914 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:31:46.697889 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:46.699163 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-5794692d-f349-458f-87d4-eeb4191c9c01 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:31:46.700441 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-5794692d-f349-458f-87d4-eeb4191c9c01 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062212 Jun 22 18:31:46.700441 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jun 22 18:31:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:46.707135 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-c2c5500a-7250-4e5f-b0de-0ac10cf6dd4f admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:46.720302 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-c2c5500a-7250-4e5f-b0de-0ac10cf6dd4f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017418 Jun 22 18:31:46.721509 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 22 18:31:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:31:46.730695 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-8b60afb4-4563-4062-a059-cebcf821352c admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:46.744759 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-8b60afb4-4563-4062-a059-cebcf821352c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017516 Jun 22 18:31:46.745282 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 22 18:31:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:31:46.754710 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-7a2bfce4-b422-4423-a769-02b620627300 admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:46.760106 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.wsgi [None req-7a2bfce4-b422-4423-a769-02b620627300 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-7a2bfce4-b422-4423-a769-02b620627300 admin admin] Request method failure captured: Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Accept: application/json Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Accept-Encoding: gzip, deflate Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Connection: keep-alive Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Content-Length: 0 Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Host: 10.222.0.18 Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Openstack-Api-Version: compute 2.90 Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Openstack-System-Scope: None Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: User-Agent: python-novaclient Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Auth-Token: gAAAAABis2ASrYJ5tCujPGmHCdCzczrNEsNsaeNXJKVJAQEpTt8A5OHXoz0csIeISAx2wRpENPk4RjFG_roKeXiQzh1Ry0XOGpjL297Gr4iFlWd-sFa_xKk_GjWlPG6tB-KceV8EIxNvi-jYA1LNvOKXiaR7gmsXW4M26ZY_H_cy9w49PEl4n-g Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Domain-Id: None Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Domain-Name: None Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Identity-Status: Confirmed Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Is-Admin-Project: True Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Project-Domain-Id: default Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Project-Domain-Name: Default Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Project-Id: 5555f070d6fd48a3923494f663482206 Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Project-Name: admin Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Role: member,reader,admin Jun 22 18:31:46.761634 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Roles: member,reader,admin Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5555f070d6fd48a3923494f663482206", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5555f070d6fd48a3923494f663482206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5555f070d6fd48a3923494f663482206"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5555f070d6fd48a3923494f663482206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Tenant: admin Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Tenant-Id: 5555f070d6fd48a3923494f663482206 Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Tenant-Name: admin Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User: admin Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User-Domain-Id: default Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User-Domain-Name: Default Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User-Id: 2a54999c7536405a8d0c6aa5dc9fba82 Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User-Name: admin Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: method: > Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: exception: Flavor 84 could not be found. Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: action_args: {'id': '84'} Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:31:46.763140 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:31:46.764083 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:46.765343 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-7a2bfce4-b422-4423-a769-02b620627300 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:31:46.766583 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-7a2bfce4-b422-4423-a769-02b620627300 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012187 Jun 22 18:31:46.766583 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jun 22 18:31:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:47.608742 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-8b60afb4-4563-4062-a059-cebcf821352c admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:47.609797 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-8b60afb4-4563-4062-a059-cebcf821352c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 22 18:31:47.610261 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 18:31:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:47.799971 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-3503bb0c-3be4-4ba9-aab4-146954cb6c01 admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:47.805730 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.wsgi [None req-3503bb0c-3be4-4ba9-aab4-146954cb6c01 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-3503bb0c-3be4-4ba9-aab4-146954cb6c01 admin admin] Request method failure captured: Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Accept: application/json Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Accept-Encoding: gzip, deflate Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Connection: keep-alive Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Content-Length: 0 Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Host: 10.222.0.18 Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Openstack-Api-Version: compute 2.90 Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Openstack-System-Scope: None Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: User-Agent: python-novaclient Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Auth-Token: gAAAAABis2AT1lkmEchnRtfYaZNnSiO-VyMuix_4osg_5pvp2QZTfgYwRJBHgjPLV8nlMOedVZWXTtqJjflZ-MAXu_sdnu3niODoP65eyCtafcupXL3_yFJUbV3xCjU8QsVL6SagZveibszkOyCRTbfVqW6xV6pAlO5BpmJREbSm8GwUXE-TUMQ Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Domain-Id: None Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Domain-Name: None Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Identity-Status: Confirmed Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Is-Admin-Project: True Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Project-Domain-Id: default Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Project-Domain-Name: Default Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Project-Id: 5555f070d6fd48a3923494f663482206 Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Project-Name: admin Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Role: member,reader,admin Jun 22 18:31:47.807231 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Roles: member,reader,admin Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5555f070d6fd48a3923494f663482206", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5555f070d6fd48a3923494f663482206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5555f070d6fd48a3923494f663482206"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5555f070d6fd48a3923494f663482206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Tenant: admin Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Tenant-Id: 5555f070d6fd48a3923494f663482206 Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-Tenant-Name: admin Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User: admin Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User-Domain-Id: default Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User-Domain-Name: Default Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User-Id: 2a54999c7536405a8d0c6aa5dc9fba82 Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: X-User-Name: admin Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: method: > Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: exception: Flavor 451 could not be found. Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: action_args: {'id': '451'} Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:31:47.808771 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:31:47.809825 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: ERROR nova.api.openstack.wsgi Jun 22 18:31:47.811196 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-3503bb0c-3be4-4ba9-aab4-146954cb6c01 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:31:47.812523 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-3503bb0c-3be4-4ba9-aab4-146954cb6c01 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062450 Jun 22 18:31:47.812523 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 22 18:31:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:47.818731 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-28798ef6-08a3-4869-b860-851ca9f3ebc6 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:47.832751 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-28798ef6-08a3-4869-b860-851ca9f3ebc6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017634 Jun 22 18:31:47.833269 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 22 18:31:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:31:47.842543 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:47.857938 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018893 Jun 22 18:31:47.858456 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 22 18:31:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:31:47.868088 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-be6ca070-cc5d-4f16-85c4-8105b4d151b2 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:47.873378 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.wsgi [None req-be6ca070-cc5d-4f16-85c4-8105b4d151b2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-be6ca070-cc5d-4f16-85c4-8105b4d151b2 admin admin] Request method failure captured: Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Accept: application/json Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Accept-Encoding: gzip, deflate Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Connection: keep-alive Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Content-Length: 0 Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Host: 10.222.0.18 Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Openstack-Api-Version: compute 2.90 Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Openstack-System-Scope: None Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: User-Agent: python-novaclient Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Auth-Token: gAAAAABis2AT1lkmEchnRtfYaZNnSiO-VyMuix_4osg_5pvp2QZTfgYwRJBHgjPLV8nlMOedVZWXTtqJjflZ-MAXu_sdnu3niODoP65eyCtafcupXL3_yFJUbV3xCjU8QsVL6SagZveibszkOyCRTbfVqW6xV6pAlO5BpmJREbSm8GwUXE-TUMQ Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Domain-Id: None Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Domain-Name: None Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Identity-Status: Confirmed Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Is-Admin-Project: True Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Project-Domain-Id: default Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Project-Domain-Name: Default Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Project-Id: 5555f070d6fd48a3923494f663482206 Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Project-Name: admin Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Role: member,reader,admin Jun 22 18:31:47.874839 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Roles: member,reader,admin Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5555f070d6fd48a3923494f663482206", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5555f070d6fd48a3923494f663482206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5555f070d6fd48a3923494f663482206"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5555f070d6fd48a3923494f663482206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Tenant: admin Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Tenant-Id: 5555f070d6fd48a3923494f663482206 Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-Tenant-Name: admin Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User: admin Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User-Domain-Id: default Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User-Domain-Name: Default Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User-Id: 2a54999c7536405a8d0c6aa5dc9fba82 Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: X-User-Name: admin Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: method: > Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: exception: Flavor 451 could not be found. Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: action_args: {'id': '451'} Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:31:47.876411 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:31:47.877980 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: ERROR nova.api.openstack.wsgi Jun 22 18:31:47.879300 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-be6ca070-cc5d-4f16-85c4-8105b4d151b2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:31:47.880354 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-be6ca070-cc5d-4f16-85c4-8105b4d151b2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011595 Jun 22 18:31:47.880354 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 22 18:31:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 18:31:48.691239 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:48.692284 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 22 18:31:48.692700 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 18:31:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:48.880105 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-b829104e-25f4-49a9-882f-5a9977885092 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:48.898804 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-b829104e-25f4-49a9-882f-5a9977885092 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070999 Jun 22 18:31:48.899328 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jun 22 18:31:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:31:49.720163 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:49.721267 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jun 22 18:31:49.721658 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 18:31:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:49.911913 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-deab678b-9426-41b6-b9e8-943bc2a51b60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:49.930991 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-deab678b-9426-41b6-b9e8-943bc2a51b60 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.072018 Jun 22 18:31:49.931460 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jun 22 18:31:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:31:50.778166 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:50.779193 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 22 18:31:50.779581 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 18:31:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:50.969585 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-2885beed-2d69-4a71-bf9c-a9707b69afa9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:50.988224 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-2885beed-2d69-4a71-bf9c-a9707b69afa9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070557 Jun 22 18:31:50.988694 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jun 22 18:31:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:31:51.839906 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:51.840958 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 22 18:31:51.841339 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 18:31:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:52.032013 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-f23469ca-3289-4a13-bf0e-5b1494aeca55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:31:52.050934 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-f23469ca-3289-4a13-bf0e-5b1494aeca55 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070513 Jun 22 18:31:52.051481 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jun 22 18:31:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:31:52.866029 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:52.867053 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 22 18:31:52.867461 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 18:31:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:31:53.057418 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-54a2b137-b959-445d-8dd8-01cfacd9adbb admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:31:53.076946 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-54a2b137-b959-445d-8dd8-01cfacd9adbb admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075049 Jun 22 18:31:53.077477 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Jun 22 18:31:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:32:40.196299 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:32:40.197297 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-1dcf8bce-161c-4af1-902c-d6143e5a8d5f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 22 18:32:40.197683 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 22 18:32:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:32:40.207982 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:32:40.256340 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-66dfbb40-5a63-4b18-ae2f-9d923e34005f admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:32:40.275106 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-66dfbb40-5a63-4b18-ae2f-9d923e34005f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071549 Jun 22 18:32:40.275670 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jun 22 18:32:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:32:40.299381 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-92e7dc71-7bc6-4701-b220-da1ae72aadc9 admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:32:40.302795 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG dbcounter [-] [103484] Writing DB stats nova_api:SELECT=14 {{(pid=103484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:32:40.308172 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-92e7dc71-7bc6-4701-b220-da1ae72aadc9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013039 Jun 22 18:32:40.308705 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Jun 22 18:32:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:32:40.320302 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-e23b3f23-1eda-427a-9df0-b8619354f645 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:32:40.327958 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-e23b3f23-1eda-427a-9df0-b8619354f645 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011214 Jun 22 18:32:40.328460 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Jun 22 18:32:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:32:40.339654 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-59923f52-863b-42ee-a726-d9fd1970f72e admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:32:40.348237 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-59923f52-863b-42ee-a726-d9fd1970f72e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012056 Jun 22 18:32:40.348736 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Jun 22 18:32:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:32:40.359814 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-e4966453-bc19-4a79-86c1-077af8740008 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:32:40.369757 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-e4966453-bc19-4a79-86c1-077af8740008 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013265 Jun 22 18:32:40.370302 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Jun 22 18:32:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:35:51.259495 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-59923f52-863b-42ee-a726-d9fd1970f72e admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:35:51.260543 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-59923f52-863b-42ee-a726-d9fd1970f72e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 22 18:35:51.260935 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 18:35:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:35:51.406739 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writing DB stats nova_api:SELECT=6 {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:35:51.521440 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-441804c1-2f01-4d30-8b4f-3f9134df898f admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:35:51.522590 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:35:51.522590 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: warnings.warn(msg) Jun 22 18:35:51.523767 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-441804c1-2f01-4d30-8b4f-3f9134df898f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:35:51.524234 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-441804c1-2f01-4d30-8b4f-3f9134df898f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:35:51.525042 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-441804c1-2f01-4d30-8b4f-3f9134df898f admin admin] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:35:51.525470 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-441804c1-2f01-4d30-8b4f-3f9134df898f admin admin] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:35:51.559443 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-441804c1-2f01-4d30-8b4f-3f9134df898f admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.154812 Jun 22 18:35:51.560012 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 22 18:35:51 2022] GET /compute/v2.1/os-services => generated 794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:35:52.434475 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-59923f52-863b-42ee-a726-d9fd1970f72e admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:35:52.435486 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-59923f52-863b-42ee-a726-d9fd1970f72e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 22 18:35:52.435893 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 18:35:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:35:52.628005 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-590549c1-e73f-4546-b3b4-55386a160248 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:35:52.629174 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:35:52.629174 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: warnings.warn(msg) Jun 22 18:35:52.630357 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-590549c1-e73f-4546-b3b4-55386a160248 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:35:52.630791 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-590549c1-e73f-4546-b3b4-55386a160248 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:35:52.631591 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-590549c1-e73f-4546-b3b4-55386a160248 admin admin] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:35:52.632049 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-590549c1-e73f-4546-b3b4-55386a160248 admin admin] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:35:52.651729 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-590549c1-e73f-4546-b3b4-55386a160248 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075136 Jun 22 18:35:52.652276 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 22 18:35:52 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:36:03.934139 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-59923f52-863b-42ee-a726-d9fd1970f72e admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:36:03.935175 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-59923f52-863b-42ee-a726-d9fd1970f72e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 22 18:36:03.935570 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 18:36:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:36:04.083127 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writing DB stats nova_cell0:SELECT=4 {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:36:04.083854 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writing DB stats nova_cell1:SELECT=4 {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:36:04.084468 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG dbcounter [-] [103485] Writing DB stats nova_api:SELECT=8 {{(pid=103485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:36:04.134815 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-a7a3ec42-adfa-4f06-82bd-8cbb09fa1762 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:36:04.135994 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:36:04.135994 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: warnings.warn(msg) Jun 22 18:36:04.137172 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-a7a3ec42-adfa-4f06-82bd-8cbb09fa1762 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:36:04.137672 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-a7a3ec42-adfa-4f06-82bd-8cbb09fa1762 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:36:04.138478 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-a7a3ec42-adfa-4f06-82bd-8cbb09fa1762 admin admin] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:36:04.138907 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-a7a3ec42-adfa-4f06-82bd-8cbb09fa1762 admin admin] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:36:04.164741 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-a7a3ec42-adfa-4f06-82bd-8cbb09fa1762 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.086022 Jun 22 18:36:04.165299 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 22 18:36:04 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:36:04.986931 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: DEBUG nova.api.openstack.wsgi [None req-59923f52-863b-42ee-a726-d9fd1970f72e admin admin] Calling method '>' {{(pid=103484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:36:04.987977 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: INFO nova.api.openstack.requestlog [None req-59923f52-863b-42ee-a726-d9fd1970f72e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 22 18:36:04.988367 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: [pid: 103484|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 22 18:36:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:36:05.183653 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG nova.api.openstack.wsgi [None req-49f1cabf-2507-44ce-8bd5-ec078f1fe575 admin admin] Calling method '>' {{(pid=103485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:36:05.184881 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 18:36:05.184881 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: warnings.warn(msg) Jun 22 18:36:05.186102 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-49f1cabf-2507-44ce-8bd5-ec078f1fe575 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:36:05.186548 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-49f1cabf-2507-44ce-8bd5-ec078f1fe575 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:36:05.187458 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-49f1cabf-2507-44ce-8bd5-ec078f1fe575 admin admin] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:36:05.187960 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: DEBUG oslo_concurrency.lockutils [None req-49f1cabf-2507-44ce-8bd5-ec078f1fe575 admin admin] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:36:05.209873 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: INFO nova.api.openstack.requestlog [None req-49f1cabf-2507-44ce-8bd5-ec078f1fe575 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.082014 Jun 22 18:36:05.210405 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: [pid: 103485|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 22 18:36:05 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:36:59.568678 dv-cinder-812685-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 22 18:36:59.569242 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: Wed Jun 22 18:36:59 2022 - graceful shutdown triggered... Jun 22 18:36:59.569709 dv-cinder-812685-11-iscsi devstack@n-api.service[103485]: Gracefully killing worker 2 (pid: 103485)... Jun 22 18:36:59.570134 dv-cinder-812685-11-iscsi devstack@n-api.service[103484]: Gracefully killing worker 1 (pid: 103484)... Jun 22 18:37:00.570131 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: worker 1 buried after 1 seconds Jun 22 18:37:00.570675 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: worker 2 buried after 1 seconds Jun 22 18:37:00.570675 dv-cinder-812685-11-iscsi devstack@n-api.service[103483]: goodbye to uWSGI. Jun 22 18:37:00.571728 dv-cinder-812685-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 22 18:37:00.572317 dv-cinder-812685-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 22 18:37:00.575156 dv-cinder-812685-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 18:37:00.585019 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 18:37:00.587631 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 18:37:00 2022] *** Jun 22 18:37:00.587783 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 18:37:00.587937 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 18:37:00.588039 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: nodename: dv-cinder-812685-11-iscsi Jun 22 18:37:00.588157 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: machine: x86_64 Jun 22 18:37:00.588274 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: clock source: unix Jun 22 18:37:00.588383 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: pcre jit disabled Jun 22 18:37:00.588491 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: detected number of CPU cores: 4 Jun 22 18:37:00.588599 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: current working directory: / Jun 22 18:37:00.588720 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: detected binary path: /usr/bin/uwsgi-core Jun 22 18:37:00.588837 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: your processes number limit is 47680 Jun 22 18:37:00.588956 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: your memory page size is 4096 bytes Jun 22 18:37:00.589075 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: detected max file descriptor number: 2048 Jun 22 18:37:00.589187 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: lock engine: pthread robust mutexes Jun 22 18:37:00.589473 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: thunder lock: enabled Jun 22 18:37:00.589650 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 18:37:00.589958 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 18:37:00.642039 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: Python main interpreter initialized at 0x55d4812739c0 Jun 22 18:37:00.642039 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: python threads support enabled Jun 22 18:37:00.642039 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: your server socket listen backlog is limited to 100 connections Jun 22 18:37:00.642039 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: your mercy for graceful operations on workers is 90 seconds Jun 22 18:37:00.642474 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 18:37:00.642474 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: *** Operational MODE: preforking *** Jun 22 18:37:00.642753 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: *** uWSGI is running in multiple interpreter mode *** Jun 22 18:37:00.642753 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: spawned uWSGI master process (pid: 129726) Jun 22 18:37:00.642957 dv-cinder-812685-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 18:37:00.647901 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: spawned uWSGI worker 1 (pid: 129743, cores: 1) Jun 22 18:37:00.647901 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: spawned uWSGI worker 2 (pid: 129744, cores: 1) Jun 22 18:37:00.647901 dv-cinder-812685-11-iscsi devstack@n-api.service[129726]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 18:37:01.311053 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 18:37:01.313563 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 18:37:02.516358 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 18:37:02.516358 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: from cryptography.utils import int_from_bytes Jun 22 18:37:02.517022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 18:37:02.517022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: from cryptography.utils import int_from_bytes Jun 22 18:37:02.533617 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 18:37:02.533617 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: from cryptography.utils import int_from_bytes Jun 22 18:37:02.534186 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 18:37:02.534186 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: from cryptography.utils import int_from_bytes Jun 22 18:37:04.893379 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 18:37:04.894010 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 18:37:04.894300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 18:37:04.894568 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 18:37:04.894826 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 18:37:04.895456 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.895783 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.896132 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.896458 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.896794 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.897112 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.897433 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.897759 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.898089 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.898351 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.898785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.898980 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-11-iscsi {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.899293 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.899610 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.899965 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.900287 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.900594 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.900913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.901221 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.901727 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.903121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.903121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.903121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.903437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.903797 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.904090 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.904404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.904696 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.905029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.905333 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.905748 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-11-iscsi {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.906611 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.906912 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.907231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.907647 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.907991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.908296 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.908606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.908942 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.909260 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.909574 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.909885 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.910217 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.910521 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.910827 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.911123 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.911454 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.911747 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.912132 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.912438 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.912687 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.912993 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.913314 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.913631 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.913955 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.914207 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.914457 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.914773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.915086 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.915395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.915700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.916038 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.916346 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.916653 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.916959 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.917265 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.917574 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.917894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.918206 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.918526 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.918834 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.919152 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.919562 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.919813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.920162 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.920506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.920826 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.921130 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.921457 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.922512 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.922830 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.923248 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.923564 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.923914 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.924260 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.924569 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.924826 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.925127 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.925433 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.925748 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.926052 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.926356 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.926678 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.926962 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.927266 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.927570 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.927915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.928212 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.928518 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.928820 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.929138 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.929429 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.929734 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.930069 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.930383 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.930687 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.930990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.931295 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.931601 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.932131 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.932446 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.932755 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.933078 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.933387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.933692 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.934009 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.934315 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.934620 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.934936 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.935243 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.935543 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.935875 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.936189 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.936498 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.936802 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.937107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.937472 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.937875 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.938280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.938592 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.938897 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.939220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.939544 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.939890 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.940209 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.940515 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.940836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.941175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.941506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.941850 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.942162 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.942504 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.942823 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.943136 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.943448 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.943762 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.944193 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.944503 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.944814 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.945125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.945446 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.945760 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.946087 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.946399 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.949116 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.949116 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.949116 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.949116 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.949116 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.949116 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.949116 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.949116 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.950395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.950395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.950395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.950395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.950991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.950991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.951278 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.951434 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.951666 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.952007 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.952325 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.952637 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.953139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.953606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.953924 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.954240 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.954591 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.954911 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.955229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.955546 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.955887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.956203 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.956518 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.956830 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.957137 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.957442 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.957745 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.958056 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.958425 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.958678 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.959007 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.959312 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.959649 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.959983 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.960297 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.960608 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.960916 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.961222 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.961535 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.961845 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.962154 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.962485 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.962796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.963310 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.963502 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.963997 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.964176 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.964362 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.964673 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.964983 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.965293 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.965601 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.965925 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.966235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.966546 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.966884 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.967218 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.967525 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.967871 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.968410 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.969064 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.969354 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.969661 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.969974 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.970274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.970576 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.970882 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.971184 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.971487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.971788 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.972134 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.972439 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.972862 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.973064 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.973575 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.973758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.974219 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.974383 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.974593 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.974936 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.975350 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.975669 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.976095 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.976409 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.976725 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.977034 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.977344 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.977653 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.977963 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.979160 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.979160 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.979160 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.979160 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.979808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.979808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.980133 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.980433 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.980744 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.981080 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.981411 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.981727 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.982046 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.982355 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.982670 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.982975 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.983281 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.983700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.983918 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.984865 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.985176 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.985494 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.985806 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.986130 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.986443 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.986759 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.987063 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.987377 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.987705 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.988077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.988388 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.988699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.988926 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 18:37:04.989424 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.989573 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 18:37:04.989720 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.990439 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 18:37:04.990539 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.990625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 18:37:04.990704 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.990778 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 18:37:04.990927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.991009 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.991088 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.991167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.991244 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.991330 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.991427 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.991631 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.991807 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.992029 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.992193 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.992352 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.992508 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.992682 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.992834 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.992987 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.993165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.993321 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.993475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.993475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.993820 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.993820 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.994118 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.994275 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.994859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-11-iscsi {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.995042 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.995199 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.995355 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.995676 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.995855 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.996023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.996177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.996332 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.996581 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.996746 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.996900 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.997061 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.997215 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.997369 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.997521 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.997675 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.997856 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.998011 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.998155 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.998308 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.998477 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.998624 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.998782 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.998934 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.999086 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.999239 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.999383 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.999536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:04.999725 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:04.999904 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.000055 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.000208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.000363 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.000521 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.000675 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.000829 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.000982 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.000982 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.001291 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-11-iscsi {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.001438 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.001689 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.001923 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.002073 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.002218 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.002374 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.002528 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.002687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.002840 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.002994 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.003151 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.003306 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.003450 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.003602 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.003748 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.003748 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.004071 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.004465 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.004998 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.005291 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.005466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.005641 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.005890 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.006152 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.006318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.006318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.006700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.006864 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.007025 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.007180 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.007326 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.007471 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.007627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.007772 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.008055 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.008454 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.008605 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.008759 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.008759 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.009054 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.009208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.009353 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.009497 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.009649 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.009803 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.009968 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.010131 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.010289 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.010441 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.010597 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.010750 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.010896 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.011049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.011203 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.011358 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.011505 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.011679 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.011910 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.012065 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.012210 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.012368 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.012521 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.012675 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.012819 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.012963 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.013107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.013262 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.013407 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.013551 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.013706 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.013851 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.014003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.014158 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.014310 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.014462 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.014606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.015116 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.015321 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.015477 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.015634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.015781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.016046 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.016046 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.016469 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.016469 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.016837 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.016837 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.017120 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.017273 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.017430 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.017585 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.017731 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.017731 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.018006 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.018240 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.018406 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.018406 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.018684 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.018828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.018980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.019135 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.019300 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.019567 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.019727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.019935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.020095 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.020256 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.020423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.020578 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.020730 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.020875 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.021020 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.021179 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.021324 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.021477 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.021630 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.021775 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.021953 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.022178 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.022330 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.022485 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.022639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.022791 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.022946 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.023117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.023341 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.023496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.023651 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.023796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.023977 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.024131 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.024322 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.024479 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.024637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.024781 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.025265 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.025419 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.025564 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.025749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.025749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.026096 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.026360 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.026595 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.026745 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.026989 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.027167 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.027333 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.027487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.027644 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.027798 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.027980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.028128 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.028300 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.028543 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.028707 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.028856 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.029013 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.029158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.029322 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.029516 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.029746 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.029906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.030061 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.030214 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.030370 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.030527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.030673 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.030830 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.031511 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.031657 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.031657 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.031983 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.032161 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.032377 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.032533 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.032680 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.032823 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.032975 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.033141 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.033294 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.033447 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.033592 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.033743 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.033899 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.034069 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.034217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.034369 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.034514 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.034665 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.034824 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.034995 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.035427 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.035587 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.035740 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.035908 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.036084 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.036239 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.036505 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.036766 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.036932 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.037178 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.037346 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.037498 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.037657 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.037809 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.037974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.038127 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.038289 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.038448 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.038612 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.038776 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.038943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.039095 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.039258 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 18:37:05.039419 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.039578 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.039758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.040034 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.040201 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.040355 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.040506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.040657 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.040820 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.040972 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.041251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.041426 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.042173 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.042334 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.042591 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.042757 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.042918 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.043071 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.043232 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.043396 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.043549 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.043701 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.043872 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.044042 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.044205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.044357 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.044507 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.044659 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.044817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.044979 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.045140 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.045633 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.045808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.045961 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.046120 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.046286 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.046438 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.046776 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.047045 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.047232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.047474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.047646 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.047801 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.047979 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.048144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.048297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.048448 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.048616 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.048777 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.048777 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.049067 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.049225 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.049393 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.049558 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.049710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.049870 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.050039 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.050293 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.050530 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.050685 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.050847 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.051006 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.051166 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.051166 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.051463 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.051624 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.051784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.051966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.052135 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.052295 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.052467 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.052726 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.052885 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.053045 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.053204 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.053356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.053521 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.053682 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.053835 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.053987 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.054145 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.054536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.054694 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.054859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.055021 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.055184 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.055336 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.055651 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.055967 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.056132 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.056284 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.056284 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.056581 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.056780 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.057058 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.057252 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.057421 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.057672 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.057831 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.057994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.058159 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.058159 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.058458 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.058618 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.058779 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.058939 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.059980 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.060090 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.060182 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.060270 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.060361 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.060436 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.060527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.060612 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.060704 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.060788 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.060885 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.060970 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.061063 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.061063 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.061226 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.061310 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.061407 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.061500 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.061592 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.061676 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.061766 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.061858 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.061966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.061966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.062626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.062722 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.062804 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.062888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.062968 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.063039 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.063115 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.063207 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.063298 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.063395 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.063488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.063571 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.063662 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.063752 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.063851 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.063955 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.064040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.064126 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.064216 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.064300 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.064395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.064481 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.064564 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.064654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.064738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.064821 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.064917 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.065002 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.065094 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.065185 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.065264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.065264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.065433 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.065517 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.065601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.065703 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.065808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.065894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.065986 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.066059 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.066150 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.066150 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.066312 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.066408 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.066492 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.066583 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.066673 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.066757 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.066847 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.066939 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.067023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.067114 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.067204 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.067317 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.067410 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.067507 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.067598 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.067690 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.067763 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.067892 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.067974 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.068060 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.068140 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.068229 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.068312 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.068403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.068495 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.068588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.068680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.068771 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.068862 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.068953 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.069049 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.069140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.069219 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.069290 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.069360 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.069430 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.069516 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.069589 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.069665 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.069665 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.069832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.069915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.070048 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.070134 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.070225 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.070225 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.070376 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.070463 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.070543 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.070633 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.070716 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.070799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.070881 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.070984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.071068 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.071158 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.071249 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.071333 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.071415 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.071510 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.071602 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.071692 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.071776 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.071885 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.071971 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.072063 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.072147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.072230 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.072312 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.072403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.072499 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.072584 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.072674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.072764 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.072848 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.072928 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.073008 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.073080 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.073242 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.073382 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.073547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.073709 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.073852 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.074024 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.074163 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.074342 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.074467 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.074656 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.074812 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.074970 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.075069 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.075284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.075382 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.075599 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.075698 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.075949 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.076085 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.076255 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.076347 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.076573 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.076665 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.076876 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.076965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.077198 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.077290 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.077508 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.077602 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.077862 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.077957 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.078212 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.078452 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.078571 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.078766 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.078873 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.079112 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.079206 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.079419 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.079519 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.079755 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.079902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.080118 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.080224 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.080444 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.080576 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.080781 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.080865 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.081090 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.081415 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.083872 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.083990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.084088 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.084176 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.084251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.084324 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.084479 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.084557 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.084636 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.084718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.084797 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.084884 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.084958 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.085031 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.085100 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.085171 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.085242 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.085242 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.085382 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.085454 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.085525 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.085525 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.085664 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.085745 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.085842 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.085927 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.086001 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.086080 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.086420 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.086530 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.086606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.086679 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.086870 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.087005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.087181 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.087317 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.087491 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.087627 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.087800 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.088099 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.088405 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.088718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.089032 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.089337 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.089500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.089652 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.089808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.089947 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.090083 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.090232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.090383 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.090530 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.090680 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.090827 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.090998 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.091141 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.091314 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.091463 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.091632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.091772 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.091973 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.092064 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.092278 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.092380 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.092605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.092697 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.092927 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.093026 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.093241 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.093333 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.094098 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.094212 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.094402 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.094717 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.094826 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.094902 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.094994 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.095145 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.095314 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.095459 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.095630 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.095773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.095977 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.096138 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.096295 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.096449 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.096607 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.096764 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.096925 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.097078 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.097248 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.097405 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.097742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.097841 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.098064 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.098160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.098382 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.098496 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.098695 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.098788 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.099011 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.099103 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.099408 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.099525 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.099749 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.099860 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.100123 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.100214 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.101190 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.101315 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.101403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.101475 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.101566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.101646 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.101718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.101788 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.101858 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.101927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.102010 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.102089 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.105773 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.105887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.105969 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.106077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.106170 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.106245 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.106326 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.106406 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.106478 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.106562 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.106642 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.106719 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.106790 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.106880 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.106951 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.107034 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.107106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.107175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.107244 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.107313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.107393 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.107473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.107554 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.107626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.107695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.107784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.107875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.107875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.108004 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.108075 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.108152 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.108242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.108315 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.108315 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.108679 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.108754 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.108825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.108905 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.109025 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.109703 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.109942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.110032 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.110120 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.110202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.110276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.110353 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.110432 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.110511 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.110592 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.110671 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.110749 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.110820 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.110890 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.111088 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.111193 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.111396 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.111501 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.111724 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.111825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.112057 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.112168 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.112362 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.112455 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.112668 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.112812 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.112979 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.113077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.113281 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.113380 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.113586 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.113685 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.113889 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.113983 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.114193 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.114284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.114500 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.114599 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.114803 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.114896 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.115109 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.115201 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.115412 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.115501 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.115724 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.115825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.116061 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.116159 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.116368 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.116473 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.116679 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.116769 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.116988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.117081 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.117308 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.117413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.117613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.117703 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.117920 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.118018 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.118227 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.118331 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.118541 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.118664 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.118849 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.118945 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.119151 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.119251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.119478 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.119570 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.119793 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.119942 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.120139 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.120353 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.120445 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.120687 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.120785 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.121006 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.121126 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.121338 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.121436 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.121651 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.121756 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.121959 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.122067 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.122265 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.122357 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.122570 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.122670 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.122885 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.122985 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.123194 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.123293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.123503 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.123594 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.123811 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.123927 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.124146 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.124246 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.124453 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.124543 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.124786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.124886 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.125096 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.125188 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.125402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.125495 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.125711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.125799 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.126014 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.126118 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.126321 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.126424 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.126628 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.126720 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.126934 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.127034 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.127240 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.127339 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.127576 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.127666 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.127906 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.128011 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.128232 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.128336 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.128547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.128781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.128885 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.128970 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.129159 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.129263 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.129470 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.129570 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.129776 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.129868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.130083 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.130183 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.130398 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.130498 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.130715 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.130847 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.131054 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.131146 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.131365 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.131457 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.131670 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.131926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.132041 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.132218 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.132348 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.132534 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.132666 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.132856 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.132984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.133165 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.133575 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.133751 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.133904 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.134076 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.134232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.134386 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.134542 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.134705 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.134856 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.135015 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.135170 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.135344 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.135483 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.135680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.135800 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.136048 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.136153 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.136374 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.136466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.136680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.136785 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.136984 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.137076 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.137288 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.137387 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.137596 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.137698 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.137912 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.138011 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.138219 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.138318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.138522 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.138628 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.138852 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.138955 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.139117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.139209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.139418 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.139519 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.139721 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.139820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.140049 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.140149 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.140864 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.141043 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.141174 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.141425 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.141521 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.141743 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.141906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.142055 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.142184 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.142355 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.142502 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.142655 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.142820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.142954 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.143133 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.143258 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.143449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.143559 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.143765 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.143892 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.144117 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.144210 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.144439 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.144543 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.144750 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.144848 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.145078 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.145176 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.145411 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.145512 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.145724 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.145816 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.146046 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.146138 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.146360 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.146464 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.146683 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.146770 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.146992 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.147084 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.147315 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.147409 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.147624 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.147713 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.147959 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.148066 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.148272 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.148363 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.148601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.148689 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.148911 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.149013 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.149221 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.149323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.149533 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.149625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.149842 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.149940 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.150150 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.150243 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.150461 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.150657 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.150788 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.150977 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.151114 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.151293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.151420 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.151623 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.151751 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.151978 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.152097 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.152311 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.152402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.152622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.152713 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.152943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.153035 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.153258 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.153358 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.153587 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.153686 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.153962 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.154067 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.154231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.154323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.154542 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.154634 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.154849 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.154929 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.155161 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.155252 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.155474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.155577 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.155797 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.156505 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.156678 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.156813 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.156988 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.157190 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.157319 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.157527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.157665 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.157848 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.157947 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.158178 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.158272 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.158510 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.158609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.158827 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.158948 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.159144 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.159247 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.159460 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.159553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.159775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.159904 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.160039 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 18:37:05.160130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.160455 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.160767 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.161087 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.161407 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.161721 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.162033 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.162345 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.162675 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.162985 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.163316 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.163639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.163994 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.164328 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.164647 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.164971 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.165287 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.165599 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.165911 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.166225 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.166577 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.166890 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.167219 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.167556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.167926 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.168250 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.168757 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.168928 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.169259 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.169579 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.169906 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.170219 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.170544 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.170859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.171169 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.171480 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.172485 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.172935 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.173408 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.173949 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.174545 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.175023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.175509 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.176168 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.176640 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.176966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.177289 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.177609 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.177969 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.178288 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.178635 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.178966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.179306 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.179648 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.179987 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.180709 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.180709 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.181250 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.181250 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.181578 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.181905 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.182228 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.182550 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.182864 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.183186 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.183507 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.183828 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.184426 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.184766 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.185118 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.185441 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.185759 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.186079 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.186399 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.186717 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.187033 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.188079 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.188385 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.188722 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.189054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.189394 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.189735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.190062 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.190390 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.190713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.191032 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.191399 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.191721 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.192062 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.192384 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.192709 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.193029 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.193430 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.193721 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.194041 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.194361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.194680 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.195007 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.195309 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.195631 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.195986 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.196331 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.196658 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.196978 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.197295 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.197615 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.198143 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.198469 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.198813 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.199148 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.199483 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.200079 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.200185 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.200483 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.200795 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.201107 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.201424 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.201738 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.202047 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.202373 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.202779 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.203037 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.203363 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.203677 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.204239 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.204590 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.204911 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.205241 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.205578 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.205913 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.206202 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.206531 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.206843 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.207154 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.207477 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.207793 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.208129 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.208440 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.208756 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.209070 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.209380 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.209696 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.210005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.210343 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.210654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.210963 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.211273 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.211622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.211919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.212232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.212541 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.212850 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.213163 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.213472 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.213787 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.214099 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.214415 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.214725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.215040 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.215395 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.215723 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.216068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.216375 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.216696 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.217011 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.217339 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.217654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.217990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.218363 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.218710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.219248 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.219589 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.219925 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.220268 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.220605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.220919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.221231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.221543 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.221871 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.222187 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.222503 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.222821 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.223139 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.223289 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO dbcounter [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] Registered counter for database nova_api Jun 22 18:37:05.223453 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.223766 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.224135 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.224433 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.224731 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.225044 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.225358 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.225672 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.226058 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.226305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.226650 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.226976 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.227301 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.227622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.227974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.228358 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.228607 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.228923 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.229239 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.229563 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.229936 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.230217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.230533 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.231052 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.231372 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.231696 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.232048 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.232365 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.232693 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.233023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.233340 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.233663 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.234558 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.234893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.235237 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.235574 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.235933 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.236250 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.236561 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.236873 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.237189 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.237515 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.237831 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.238141 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.238494 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.239650 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.239650 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.239650 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.239650 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.240495 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.240495 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.240673 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.240894 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.241203 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.241514 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.241931 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.242137 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.242436 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.242746 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.243056 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.243384 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.243673 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.244006 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.244104 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_db.sqlalchemy.engines [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:37:05.244347 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.244687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.245006 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.245334 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.245653 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.245981 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.246296 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.246624 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.246951 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.247274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.247587 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.247957 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.248278 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.248594 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.248912 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.249226 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.249542 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.250502 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.250845 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.251182 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.251360 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writer thread running {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:37:05.251497 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.251842 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.252180 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.252509 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.252846 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.253150 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.253485 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.253803 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.254118 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.254441 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.254756 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.255075 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.255395 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.255715 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.256072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.256405 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.256717 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.257047 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.257380 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.257733 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.258052 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.258655 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.258986 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.259306 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.259628 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.259961 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 18:37:05.260212 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 18:37:05.307925 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.context [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a31ed574-36eb-4581-9846-6247202b74dc(cell1) {{(pid=129743) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 18:37:05.312761 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:37:05.314575 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:37:05.315381 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:37:05.317336 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:37:05.319299 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO dbcounter [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] Registered counter for database nova_cell0 Jun 22 18:37:05.323318 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO dbcounter [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] Registered counter for database nova_cell1 Jun 22 18:37:05.324116 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO dbcounter [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] Registered counter for database nova_api Jun 22 18:37:05.332145 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_db.sqlalchemy.engines [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:37:05.332983 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_db.sqlalchemy.engines [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:37:05.338886 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writer thread running {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:37:05.340513 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writer thread running {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:37:05.344549 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_db.sqlalchemy.engines [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:37:05.351116 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writer thread running {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:37:05.408926 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.context [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a31ed574-36eb-4581-9846-6247202b74dc(cell1) {{(pid=129744) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 18:37:05.412969 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:37:05.414566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:37:05.415378 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:37:05.417364 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:37:05.419353 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO dbcounter [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] Registered counter for database nova_cell0 Jun 22 18:37:05.423979 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO dbcounter [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] Registered counter for database nova_cell1 Jun 22 18:37:05.431423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_db.sqlalchemy.engines [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:37:05.433795 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_db.sqlalchemy.engines [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:37:05.440190 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writer thread running {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:37:05.441489 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writer thread running {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:37:05.489603 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO dbcounter [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] Registered counter for database nova_cell0 Jun 22 18:37:05.496178 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_db.sqlalchemy.engines [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:37:05.501206 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writer thread running {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:37:05.591264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO dbcounter [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] Registered counter for database nova_cell0 Jun 22 18:37:05.598038 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_db.sqlalchemy.engines [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 18:37:05.602619 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writer thread running {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 18:37:05.851235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: WARNING keystonemiddleware.auth_token [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 18:37:05.858629 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: WARNING keystonemiddleware.auth_token [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 18:37:05.923484 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: WARNING keystonemiddleware.auth_token [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 18:37:05.930727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: WARNING keystonemiddleware.auth_token [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 18:37:06.224265 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: WARNING keystonemiddleware.auth_token [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 18:37:06.231882 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: WARNING keystonemiddleware.auth_token [None req-6e3305a3-7966-484e-ba55-894e3d40044a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 18:37:06.236265 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d4812739c0 pid: 129743 (default app) Jun 22 18:37:06.277314 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: WARNING keystonemiddleware.auth_token [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 18:37:06.283479 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: WARNING keystonemiddleware.auth_token [None req-b2605a61-3405-4fba-8e5e-c3abebb03871 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 18:37:06.288806 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d4812739c0 pid: 129744 (default app) Jun 22 18:37:45.299385 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=3 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:45.300366 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=3 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:45.301137 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=3 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:45.302230 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=3 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:46.393382 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-72f39325-cf9a-4dbd-be05-8e564127b51d tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Action: 'create', calling method: .version_select at 0x7fd7574eb790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-505157398", "metadata": {"Type": "work"}}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-72f39325-cf9a-4dbd-be05-8e564127b51d tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Request method failure captured: Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 121 Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2F5x3n2Ch__PfFhaY_bN9-Btuy1arkY_9Rt2hIAD9dgK3wpM1VIEY-83WEuUnDeTPDBvmaxk0Z4H9v0GwNt1Spzqi8Pr2Z9VcV2BolWyEk_r3g-cJ-qmutfrSHOn_wUF7oRzsfLtzkT9fdF66LmT0XcmDVbq9OFsWRU2C3J8Q5nzOM Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: f3edb8dc4f1946dc985dd1c0fb510c07 Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:37:46.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:37:46.417027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f3edb8dc4f1946dc985dd1c0fb510c07", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:37:46.417027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:46.417027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: f3edb8dc4f1946dc985dd1c0fb510c07 Jun 22 18:37:46.417027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:46.417027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-VolumesNegativeTest-235353291-project Jun 22 18:37:46.417027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:37:46.417027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:37:46.417027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 562ad996aece4a77a551a9a673cce958 Jun 22 18:37:46.417027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-VolumesNegativeTest-235353291-project Jun 22 18:37:46.417027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Jun 22 18:37:46.417027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-505157398", "metadata": {"Type": "work"}}} Jun 22 18:37:46.417027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: Jun 22 18:37:46.417027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-505157398', 'metadata': {'Type': 'work'}}}} Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise error Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi '#$%' Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:37:46.418047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 18:37:46.419634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 18:37:46.421002 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 18:37:46.421002 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.421002 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-72f39325-cf9a-4dbd-be05-8e564127b51d tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:37:46.421002 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-72f39325-cf9a-4dbd-be05-8e564127b51d tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.135316 Jun 22 18:37:46.421002 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jun 22 18:37:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 18:37:46.430424 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=3 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:46.431478 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=3 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:46.432364 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=3 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:46.434216 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=3 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:37:46.719793 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8bef9a86-f2dc-44ce-b5c9-e7e386722023 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Action: 'create', calling method: .version_select at 0x7fd75753c1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-505548646", "metadata": {"Type": "work"}}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8bef9a86-f2dc-44ce-b5c9-e7e386722023 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Request method failure captured: Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 119 Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2F5x3n2Ch__PfFhaY_bN9-Btuy1arkY_9Rt2hIAD9dgK3wpM1VIEY-83WEuUnDeTPDBvmaxk0Z4H9v0GwNt1Spzqi8Pr2Z9VcV2BolWyEk_r3g-cJ-qmutfrSHOn_wUF7oRzsfLtzkT9fdF66LmT0XcmDVbq9OFsWRU2C3J8Q5nzOM Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: f3edb8dc4f1946dc985dd1c0fb510c07 Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:37:46.728711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:37:46.730361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f3edb8dc4f1946dc985dd1c0fb510c07", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:37:46.730361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:46.730361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: f3edb8dc4f1946dc985dd1c0fb510c07 Jun 22 18:37:46.730361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:46.730361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-VolumesNegativeTest-235353291-project Jun 22 18:37:46.730361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:37:46.730361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:37:46.730361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 562ad996aece4a77a551a9a673cce958 Jun 22 18:37:46.730361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-VolumesNegativeTest-235353291-project Jun 22 18:37:46.730361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Jun 22 18:37:46.730361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-505548646", "metadata": {"Type": "work"}}} Jun 22 18:37:46.730361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: Jun 22 18:37:46.730361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-505548646', 'metadata': {'Type': 'work'}}}} Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise error Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi '0' Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:37:46.731323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 18:37:46.732990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 18:37:46.734334 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 18:37:46.734334 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.734334 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8bef9a86-f2dc-44ce-b5c9-e7e386722023 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:37:46.736134 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8bef9a86-f2dc-44ce-b5c9-e7e386722023 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.310955 Jun 22 18:37:46.737022 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 1/2] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jun 22 18:37:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 313 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 18:37:46.746242 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f7f6d7b9-ffa4-4deb-ad1a-8c2a83172248 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Action: 'create', calling method: .version_select at 0x7fd757463a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-675878028", "metadata": {"Type": "work"}}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f7f6d7b9-ffa4-4deb-ad1a-8c2a83172248 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Request method failure captured: Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 118 Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2F5x3n2Ch__PfFhaY_bN9-Btuy1arkY_9Rt2hIAD9dgK3wpM1VIEY-83WEuUnDeTPDBvmaxk0Z4H9v0GwNt1Spzqi8Pr2Z9VcV2BolWyEk_r3g-cJ-qmutfrSHOn_wUF7oRzsfLtzkT9fdF66LmT0XcmDVbq9OFsWRU2C3J8Q5nzOM Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: f3edb8dc4f1946dc985dd1c0fb510c07 Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:37:46.751335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:37:46.753572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f3edb8dc4f1946dc985dd1c0fb510c07", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:37:46.753572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:46.753572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: f3edb8dc4f1946dc985dd1c0fb510c07 Jun 22 18:37:46.753572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:46.753572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-VolumesNegativeTest-235353291-project Jun 22 18:37:46.753572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:37:46.753572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:37:46.753572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 562ad996aece4a77a551a9a673cce958 Jun 22 18:37:46.753572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-VolumesNegativeTest-235353291-project Jun 22 18:37:46.753572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Jun 22 18:37:46.753572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-675878028", "metadata": {"Type": "work"}}} Jun 22 18:37:46.753572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: Jun 22 18:37:46.753572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-675878028', 'metadata': {'Type': 'work'}}}} Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise error Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi '' Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:37:46.755147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 18:37:46.757944 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 18:37:46.763049 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 18:37:46.763049 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:46.763049 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f7f6d7b9-ffa4-4deb-ad1a-8c2a83172248 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:37:46.763049 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f7f6d7b9-ffa4-4deb-ad1a-8c2a83172248 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015449 Jun 22 18:37:46.763049 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jun 22 18:37:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 18:37:46.773075 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-207ce34e-c89e-4024-9fb8-e5093d000850 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Calling method '.version_select at 0x7fd7573dc550>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:37:47.535560 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f7218d45-a7b1-42fc-abe1-85017b411ef0 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] Action: 'create', calling method: .version_select at 0x7fd7574ebb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1254593820", "metadata": {"Type": "work"}}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:37:48.630930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-207ce34e-c89e-4024-9fb8-e5093d000850 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] HTTP exception thrown: Volume tempest-invalid-905763392 could not be found. Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-207ce34e-c89e-4024-9fb8-e5093d000850 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Request method failure captured: Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-905763392 HTTP/1.1 Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2F5x3n2Ch__PfFhaY_bN9-Btuy1arkY_9Rt2hIAD9dgK3wpM1VIEY-83WEuUnDeTPDBvmaxk0Z4H9v0GwNt1Spzqi8Pr2Z9VcV2BolWyEk_r3g-cJ-qmutfrSHOn_wUF7oRzsfLtzkT9fdF66LmT0XcmDVbq9OFsWRU2C3J8Q5nzOM Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: f3edb8dc4f1946dc985dd1c0fb510c07 Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:37:48.635106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:37:48.636643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f3edb8dc4f1946dc985dd1c0fb510c07", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:37:48.636643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:48.636643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: f3edb8dc4f1946dc985dd1c0fb510c07 Jun 22 18:37:48.636643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:48.636643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-VolumesNegativeTest-235353291-project Jun 22 18:37:48.636643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:37:48.636643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:37:48.636643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 562ad996aece4a77a551a9a673cce958 Jun 22 18:37:48.636643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-VolumesNegativeTest-235353291-project Jun 22 18:37:48.636643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: Jun 22 18:37:48.636643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Volume tempest-invalid-905763392 could not be found. Jun 22 18:37:48.636643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': 'tempest-invalid-905763392'} Jun 22 18:37:48.636643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-905763392 could not be found. (HTTP 404) (Request-ID: req-04eb8ca1-940d-4b91-90a9-f4d75e435991) Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:48.637516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 18:37:48.639307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-905763392 could not be found. Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:37:48.641600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-905763392 could not be found. Jun 22 18:37:48.643423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.643423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:48.643423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.643423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:48.643423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:48.643423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:48.643423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:37:48.643423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:37:48.643423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-905763392 could not be found. Jun 22 18:37:48.643423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.643423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-207ce34e-c89e-4024-9fb8-e5093d000850 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Returning 404 to user: Volume tempest-invalid-905763392 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:37:48.643423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-207ce34e-c89e-4024-9fb8-e5093d000850 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-905763392" status: 404 len: 98 microversion: 2.1 time: 1.869625 Jun 22 18:37:48.643423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1214 bytes} [Wed Jun 22 18:37:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-905763392 => generated 98 bytes in 1871 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 22 18:37:48.652237 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-742a09a2-e8b6-4712-aada-f629da75c410 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004189 Jun 22 18:37:48.660387 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 3/5] 10.222.0.18 () {58 vars in 1139 bytes} [Wed Jun 22 18:37:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 18:37:48.665422 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d26a7b82-eb2d-48f0-b078-78c3de67ec4a tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003910 Jun 22 18:37:48.666168 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 4/6] 10.222.0.18 () {58 vars in 1136 bytes} [Wed Jun 22 18:37:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 18:37:48.685323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3856e03d-812d-4f5d-8fce-9aef8630a3d8 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Calling method '.version_select at 0x7fd7573404c0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:37:48.745650 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-3856e03d-812d-4f5d-8fce-9aef8630a3d8 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] HTTP exception thrown: Volume 08236e2e-80bc-4291-90e9-df0f51a76ee4 could not be found. Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3856e03d-812d-4f5d-8fce-9aef8630a3d8 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Request method failure captured: Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: DELETE /compute/v2.1/os-volumes/08236e2e-80bc-4291-90e9-df0f51a76ee4 HTTP/1.1 Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2F5x3n2Ch__PfFhaY_bN9-Btuy1arkY_9Rt2hIAD9dgK3wpM1VIEY-83WEuUnDeTPDBvmaxk0Z4H9v0GwNt1Spzqi8Pr2Z9VcV2BolWyEk_r3g-cJ-qmutfrSHOn_wUF7oRzsfLtzkT9fdF66LmT0XcmDVbq9OFsWRU2C3J8Q5nzOM Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: f3edb8dc4f1946dc985dd1c0fb510c07 Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:37:48.749318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:37:48.750661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f3edb8dc4f1946dc985dd1c0fb510c07", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:37:48.750661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:48.750661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: f3edb8dc4f1946dc985dd1c0fb510c07 Jun 22 18:37:48.750661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:48.750661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-VolumesNegativeTest-235353291-project Jun 22 18:37:48.750661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:37:48.750661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:37:48.750661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 562ad996aece4a77a551a9a673cce958 Jun 22 18:37:48.750661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-VolumesNegativeTest-235353291-project Jun 22 18:37:48.750661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: Jun 22 18:37:48.750661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Volume 08236e2e-80bc-4291-90e9-df0f51a76ee4 could not be found. Jun 22 18:37:48.750661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '08236e2e-80bc-4291-90e9-df0f51a76ee4'} Jun 22 18:37:48.750661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08236e2e-80bc-4291-90e9-df0f51a76ee4 could not be found. (HTTP 404) (Request-ID: req-93ec5a26-cc3c-4d22-8cbf-425f21cf1d7c) Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:48.751538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 18:37:48.752706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08236e2e-80bc-4291-90e9-df0f51a76ee4 could not be found. Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 18:37:48.753781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:37:48.754844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08236e2e-80bc-4291-90e9-df0f51a76ee4 could not be found. Jun 22 18:37:48.754844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.754844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:48.754844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.754844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:48.754844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:48.754844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:48.754844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:37:48.754844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:37:48.754844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08236e2e-80bc-4291-90e9-df0f51a76ee4 could not be found. Jun 22 18:37:48.754844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.759541 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3856e03d-812d-4f5d-8fce-9aef8630a3d8 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Returning 404 to user: Volume 08236e2e-80bc-4291-90e9-df0f51a76ee4 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:37:48.761341 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3856e03d-812d-4f5d-8fce-9aef8630a3d8 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/08236e2e-80bc-4291-90e9-df0f51a76ee4" status: 404 len: 109 microversion: 2.1 time: 0.079682 Jun 22 18:37:48.767586 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 5/7] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 18:37:48 2022] DELETE /compute/v2.1/os-volumes/08236e2e-80bc-4291-90e9-df0f51a76ee4 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:37:48.777870 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a7a247d2-ca2c-4fad-8cc1-fd7ae836d819 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Calling method '.version_select at 0x7fd757313dc0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:37:48.831755 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-a7a247d2-ca2c-4fad-8cc1-fd7ae836d819 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] HTTP exception thrown: Volume b0830354-b87a-4377-8592-0307579702df could not be found. Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a7a247d2-ca2c-4fad-8cc1-fd7ae836d819 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Request method failure captured: Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/os-volumes/b0830354-b87a-4377-8592-0307579702df HTTP/1.1 Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2F5x3n2Ch__PfFhaY_bN9-Btuy1arkY_9Rt2hIAD9dgK3wpM1VIEY-83WEuUnDeTPDBvmaxk0Z4H9v0GwNt1Spzqi8Pr2Z9VcV2BolWyEk_r3g-cJ-qmutfrSHOn_wUF7oRzsfLtzkT9fdF66LmT0XcmDVbq9OFsWRU2C3J8Q5nzOM Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: f3edb8dc4f1946dc985dd1c0fb510c07 Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:37:48.834625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:37:48.836018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f3edb8dc4f1946dc985dd1c0fb510c07", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3edb8dc4f1946dc985dd1c0fb510c07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:37:48.836018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:48.836018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: f3edb8dc4f1946dc985dd1c0fb510c07 Jun 22 18:37:48.836018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-VolumesNegativeTest-235353291 Jun 22 18:37:48.836018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-VolumesNegativeTest-235353291-project Jun 22 18:37:48.836018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:37:48.836018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:37:48.836018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 562ad996aece4a77a551a9a673cce958 Jun 22 18:37:48.836018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-VolumesNegativeTest-235353291-project Jun 22 18:37:48.836018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: Jun 22 18:37:48.836018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Volume b0830354-b87a-4377-8592-0307579702df could not be found. Jun 22 18:37:48.836018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': 'b0830354-b87a-4377-8592-0307579702df'} Jun 22 18:37:48.836018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0830354-b87a-4377-8592-0307579702df could not be found. (HTTP 404) (Request-ID: req-3f30f7d4-c397-487e-a071-8b259ae414f7) Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:48.836819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 18:37:48.837988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0830354-b87a-4377-8592-0307579702df could not be found. Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 18:37:48.839218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:37:48.842534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0830354-b87a-4377-8592-0307579702df could not be found. Jun 22 18:37:48.842534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.842534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:48.842534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.842534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:48.842534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:48.842534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:48.842534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:37:48.842534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:37:48.842534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0830354-b87a-4377-8592-0307579702df could not be found. Jun 22 18:37:48.842534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:37:48.847671 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a7a247d2-ca2c-4fad-8cc1-fd7ae836d819 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] Returning 404 to user: Volume b0830354-b87a-4377-8592-0307579702df could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:37:48.849853 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a7a247d2-ca2c-4fad-8cc1-fd7ae836d819 tempest-VolumesNegativeTest-235353291 tempest-VolumesNegativeTest-235353291-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b0830354-b87a-4377-8592-0307579702df" status: 404 len: 109 microversion: 2.1 time: 0.080919 Jun 22 18:37:48.860715 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 6/8] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:37:48 2022] GET /compute/v2.1/os-volumes/b0830354-b87a-4377-8592-0307579702df => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:37:49.813834 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f7218d45-a7b1-42fc-abe1-85017b411ef0 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.600430 Jun 22 18:37:49.815242 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 3/9] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jun 22 18:37:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2603 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 18:37:49.853347 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9f073cf7-0d24-44eb-8d56-fac7e17f1dc0 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] Calling method '.version_select at 0x7fd75759d3a0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:37:49.974256 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9f073cf7-0d24-44eb-8d56-fac7e17f1dc0 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/4b0b1247-b144-4b0a-bc6b-d6e6712c094a" status: 200 len: 353 microversion: 2.1 time: 0.150582 Jun 22 18:37:49.975035 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 7/10] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:37:49 2022] GET /compute/v2.1/os-volumes/4b0b1247-b144-4b0a-bc6b-d6e6712c094a => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:37:50.988380 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e3e3f5e2-ae1b-41f7-b14a-b02e3ef03914 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] Calling method '.version_select at 0x7fd7573800d0>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:37:51.119420 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e3e3f5e2-ae1b-41f7-b14a-b02e3ef03914 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/4b0b1247-b144-4b0a-bc6b-d6e6712c094a" status: 200 len: 354 microversion: 2.1 time: 0.135227 Jun 22 18:37:51.120395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 4/11] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:37:50 2022] GET /compute/v2.1/os-volumes/4b0b1247-b144-4b0a-bc6b-d6e6712c094a => generated 354 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:37:51.132125 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-05b71d0d-7c50-4e99-b57f-cd829004e278 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] Calling method '.version_select at 0x7fd7573408b0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:37:51.231742 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-05b71d0d-7c50-4e99-b57f-cd829004e278 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/4b0b1247-b144-4b0a-bc6b-d6e6712c094a" status: 200 len: 354 microversion: 2.1 time: 0.103883 Jun 22 18:37:51.232924 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 8/12] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:37:51 2022] GET /compute/v2.1/os-volumes/4b0b1247-b144-4b0a-bc6b-d6e6712c094a => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:37:51.249838 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d91547b4-bff2-4752-af1e-bebdd6ee8e21 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] Calling method '.version_select at 0x7fd757380790>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:37:51.433471 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d91547b4-bff2-4752-af1e-bebdd6ee8e21 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/4b0b1247-b144-4b0a-bc6b-d6e6712c094a" status: 202 len: 0 microversion: 2.1 time: 0.188126 Jun 22 18:37:51.434005 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 5/13] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 18:37:51 2022] DELETE /compute/v2.1/os-volumes/4b0b1247-b144-4b0a-bc6b-d6e6712c094a => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:37:51.443393 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-848a5ea3-3626-44c9-92d7-509d8d5ca953 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] Calling method '.version_select at 0x7fd757340820>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:37:51.573164 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-848a5ea3-3626-44c9-92d7-509d8d5ca953 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/4b0b1247-b144-4b0a-bc6b-d6e6712c094a" status: 200 len: 353 microversion: 2.1 time: 0.134033 Jun 22 18:37:51.574289 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 9/14] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:37:51 2022] GET /compute/v2.1/os-volumes/4b0b1247-b144-4b0a-bc6b-d6e6712c094a => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:37:52.588536 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-9bef975d-c22d-4b4b-89ab-ba57cdb0dab6 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] Calling method '.version_select at 0x7fd757380af0>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:37:52.688148 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-9bef975d-c22d-4b4b-89ab-ba57cdb0dab6 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] HTTP exception thrown: Volume 4b0b1247-b144-4b0a-bc6b-d6e6712c094a could not be found. Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-9bef975d-c22d-4b4b-89ab-ba57cdb0dab6 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] Request method failure captured: Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/os-volumes/4b0b1247-b144-4b0a-bc6b-d6e6712c094a HTTP/1.1 Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2F72s3H96uQsV8lb0O0GpByIJcRjpwH2gEqZotTVksjC12YgyL6uHXTK_hpXyy7_upxrPjckFUUwLzWT7lLPAKOElRKybuMX48AifvMSDWi9g1AQjw62PfPv4PsvRKQaqXRv6Naz1bngAAn260r4NExkjLiFZFEoM8_DJr67De2bd0 Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 966e6f6793f54469984c1edc47fb9437 Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-VolumesGetTestJSON-1697828473 Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:37:52.692906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:37:52.693836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_966e6f6793f54469984c1edc47fb9437", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/966e6f6793f54469984c1edc47fb9437"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/966e6f6793f54469984c1edc47fb9437"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/966e6f6793f54469984c1edc47fb9437"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:37:52.693836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-VolumesGetTestJSON-1697828473 Jun 22 18:37:52.693836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 966e6f6793f54469984c1edc47fb9437 Jun 22 18:37:52.693836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-VolumesGetTestJSON-1697828473 Jun 22 18:37:52.693836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-VolumesGetTestJSON-1697828473-project Jun 22 18:37:52.693836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:37:52.693836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:37:52.693836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 5e181ccfa7114f829b8a45397f39c99a Jun 22 18:37:52.693836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-VolumesGetTestJSON-1697828473-project Jun 22 18:37:52.693836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: Jun 22 18:37:52.693836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Volume 4b0b1247-b144-4b0a-bc6b-d6e6712c094a could not be found. Jun 22 18:37:52.693836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '4b0b1247-b144-4b0a-bc6b-d6e6712c094a'} Jun 22 18:37:52.693836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4b0b1247-b144-4b0a-bc6b-d6e6712c094a could not be found. (HTTP 404) (Request-ID: req-e0318aa7-4f84-4f50-b57d-fea8bf174d6e) Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:52.694413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 18:37:52.695235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4b0b1247-b144-4b0a-bc6b-d6e6712c094a could not be found. Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 18:37:52.696527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:37:52.697387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4b0b1247-b144-4b0a-bc6b-d6e6712c094a could not be found. Jun 22 18:37:52.697387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:52.697387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:37:52.697387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:52.697387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:37:52.697387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:37:52.697387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:37:52.697387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:37:52.697387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:37:52.697387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4b0b1247-b144-4b0a-bc6b-d6e6712c094a could not be found. Jun 22 18:37:52.697387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:37:52.697387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-9bef975d-c22d-4b4b-89ab-ba57cdb0dab6 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] Returning 404 to user: Volume 4b0b1247-b144-4b0a-bc6b-d6e6712c094a could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:37:52.697387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-9bef975d-c22d-4b4b-89ab-ba57cdb0dab6 tempest-VolumesGetTestJSON-1697828473 tempest-VolumesGetTestJSON-1697828473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/4b0b1247-b144-4b0a-bc6b-d6e6712c094a" status: 404 len: 109 microversion: 2.1 time: 0.111913 Jun 22 18:37:52.698943 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 6/15] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:37:52 2022] GET /compute/v2.1/os-volumes/4b0b1247-b144-4b0a-bc6b-d6e6712c094a => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:38:04.340077 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1160419964", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "networks": [{"uuid": "cb0b5d8f-00ef-45ac-a0a7-b1cbdbdf5d71"}]}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:38:04.584948 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.network.neutron [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] validate_networks() for [('cb0b5d8f-00ef-45ac-a0a7-b1cbdbdf5d71', None, None, None, None, None)] {{(pid=129744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:38:05.316076 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-46b68e97-ff63-4b49-bbd0-43b028f02365 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Action: 'create', calling method: .version_select at 0x7fd7573804c0>, body: {"keypair": {"name": "tempest-keypair-2035708385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDieUPtB/LMehz0iD6wS+CpGCHAEQ7v/i6P8lFD5xUne6feUGKmtsTAZg6WyrU9HfUVu2PMKETRAAVT4dmoL4uu/4d4mKHN0QtmHwE8v8+KHAfm/it/2bel5Lb/NTHImCg=="}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:38:05.563825 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-46b68e97-ff63-4b49-bbd0-43b028f02365 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Getting quotas for project bd1ef211ea584b0abd50b02208966d7a. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:38:05.578380 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-46b68e97-ff63-4b49-bbd0-43b028f02365 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Getting quotas for user 8978ed54252843f78b0d00d37b475ad2 and project bd1ef211ea584b0abd50b02208966d7a. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:38:05.734179 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-46b68e97-ff63-4b49-bbd0-43b028f02365 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.292010 Jun 22 18:38:05.736003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 7/16] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Jun 22 18:38:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1295 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 18:38:06.446506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-cd16fc84-3eac-4f0b-8c74-a3a5771d4012 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Action: 'create', calling method: .version_select at 0x7fd75729f820>, body: {"keypair": {"name": "tempest-keypair-156826004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNwRiwd8I59yi0YyF6/W+3i2AMGsbV/cpM67UtktR1dOgRxgGpT4vefFCbIHT5QjX4Y45TJyaymWiPEXpRQZIpf8AI4KUA+JR3PNHDuzw+p0pXNOXYw3Ssx4UYj6KwQAg=="}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:38:06.516214 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-cd16fc84-3eac-4f0b-8c74-a3a5771d4012 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Getting quotas for project b91b10b850024bae8e0d76aa9628224d. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:38:06.533042 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-cd16fc84-3eac-4f0b-8c74-a3a5771d4012 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Getting quotas for user d32582f1a1994e3b9c05f56185d0079d and project b91b10b850024bae8e0d76aa9628224d. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:38:06.615590 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-cd16fc84-3eac-4f0b-8c74-a3a5771d4012 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.877004 Jun 22 18:38:06.620268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 8/17] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 18:38:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:38:07.549236 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2105220153", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:38:07.739393 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.network.neutron [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] validate_networks() for [('7fedf922-6bd0-4d18-856d-d78514e18614', None, None, None, None, None)] {{(pid=129743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:38:08.912103 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Flavor limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:38:08.912645 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Image limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:38:08.912922 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Flavor pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:38:08.913461 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Image pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:38:08.913874 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:38:08.976221 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:08.976688 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:08.977537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:08.977975 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:09.148260 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Getting quotas for project 61c31a31afc94f8688241b713ec3e892. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:38:09.172072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Getting quotas for user 3eae8de1576148ed83eaf66da7971818 and project 61c31a31afc94f8688241b713ec3e892. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:38:09.235179 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Going to run 1 instances... {{(pid=129744) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:38:09.246684 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:38:09.473054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ac73f2b6-ec1e-4d24-8360-b0b3b9e77be8 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.156360 Jun 22 18:38:09.474402 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 10/18] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:38:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 6158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:38:09.487429 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cbe9d997-0f06-4228-a08f-cbd320bdfa8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:09.489605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cbe9d997-0f06-4228-a08f-cbd320bdfa8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:09.711629 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cbe9d997-0f06-4228-a08f-cbd320bdfa8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:09.750509 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cbe9d997-0f06-4228-a08f-cbd320bdfa8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1215 microversion: 2.1 time: 0.269012 Jun 22 18:38:09.756398 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 11/19] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:09 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:10.773962 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-66177615-6620-4a7e-9b4a-be65be6b8d5d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:10.774574 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-66177615-6620-4a7e-9b4a-be65be6b8d5d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:10.912292 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-66177615-6620-4a7e-9b4a-be65be6b8d5d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:10.919360 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-66177615-6620-4a7e-9b4a-be65be6b8d5d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1215 microversion: 2.1 time: 0.149048 Jun 22 18:38:10.923546 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 12/20] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:10 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:11.168673 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-723449961", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e36f357-f184-4666-b4f8-3b7e32281f23"}], "security_groups": [{"name": "tempest-securitygroup--615694092"}], "key_name": "tempest-keypair-2035708385", "user_data": "}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:38:11.382173 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.network.neutron [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] validate_networks() for [('3e36f357-f184-4666-b4f8-3b7e32281f23', None, None, None, None, None)] {{(pid=129744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:38:11.412952 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Flavor limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:38:11.413488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Image limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:38:11.413872 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Flavor pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:38:11.414336 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Image pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:38:11.414810 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:38:11.433074 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:11.434277 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:11.435343 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:11.436086 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:11.502550 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Getting quotas for project d866c4a659e74e42a3c37050eae82229. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:38:11.512267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Getting quotas for user 94d5713dc97f442f916b22d925c35042 and project d866c4a659e74e42a3c37050eae82229. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:38:11.547014 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Going to run 1 instances... {{(pid=129743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:38:11.555467 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:38:11.750650 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7ce3b34c-af03-4d28-a11c-49ab774906d0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.863725 Jun 22 18:38:11.751941 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 9/21] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:38:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 4866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:38:11.772234 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-138236486", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2646f914-6f7d-47fd-80ab-e013c343a932"}], "security_groups": [{"name": "tempest-securitygroup--1859205625"}], "key_name": "tempest-keypair-156826004", "user_data": "}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:38:12.145056 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.network.neutron [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] validate_networks() for [('2646f914-6f7d-47fd-80ab-e013c343a932', None, None, None, None, None)] {{(pid=129743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:38:12.189018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Flavor limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:38:12.190073 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Image limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:38:12.190707 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Flavor pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:38:12.191273 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Image pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:38:12.191864 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:38:12.211001 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:12.213131 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:12.215479 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:12.217003 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:12.274379 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Getting quotas for project bd1ef211ea584b0abd50b02208966d7a. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:38:12.280333 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Getting quotas for user 8978ed54252843f78b0d00d37b475ad2 and project bd1ef211ea584b0abd50b02208966d7a. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:38:12.329831 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Going to run 1 instances... {{(pid=129744) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:38:12.335308 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:38:12.566074 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-be1e5ba3-c69d-4cae-b354-94f4eaaea0c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.406981 Jun 22 18:38:12.580022 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 13/22] 10.222.0.18 () {62 vars in 1187 bytes} [Wed Jun 22 18:38:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 18:38:12.619421 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-93179f5b-06b3-430d-96e8-fdecd798fbc8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:12.620493 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-93179f5b-06b3-430d-96e8-fdecd798fbc8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:12.743161 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-93179f5b-06b3-430d-96e8-fdecd798fbc8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:12.761693 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-93179f5b-06b3-430d-96e8-fdecd798fbc8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1222 microversion: 2.1 time: 0.180489 Jun 22 18:38:12.762260 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 14/23] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:12 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:12.804924 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ea5a98bb-e311-4ce1-a1c3-3795469e1c5a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:12.805638 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ea5a98bb-e311-4ce1-a1c3-3795469e1c5a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:12.823144 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ea5a98bb-e311-4ce1-a1c3-3795469e1c5a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:12.823593 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ea5a98bb-e311-4ce1-a1c3-3795469e1c5a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:12.826538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ea5a98bb-e311-4ce1-a1c3-3795469e1c5a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:12.826538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ea5a98bb-e311-4ce1-a1c3-3795469e1c5a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:13.211575 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Flavor limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:38:13.212240 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Image limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:38:13.212487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Flavor pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:38:13.213091 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Image pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:38:13.213650 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:38:13.241185 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:13.241530 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:13.246820 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:13.248045 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:13.322095 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Getting quotas for project b91b10b850024bae8e0d76aa9628224d. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:38:13.363121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Getting quotas for user d32582f1a1994e3b9c05f56185d0079d and project b91b10b850024bae8e0d76aa9628224d. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:38:13.443852 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Going to run 1 instances... {{(pid=129743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:38:13.446556 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:38:13.461033 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ea5a98bb-e311-4ce1-a1c3-3795469e1c5a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:13.489484 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ea5a98bb-e311-4ce1-a1c3-3795469e1c5a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1219 microversion: 2.1 time: 0.693907 Jun 22 18:38:13.493853 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 15/24] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:12 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1219 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:13.501548 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-bceaeebc-2447-4389-94c3-63c19efdf83f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:13.511545 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-bceaeebc-2447-4389-94c3-63c19efdf83f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:13.604132 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-dba1e75e-a3a0-4316-b1c3-9def3bf8c88b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.850733 Jun 22 18:38:13.625584 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 10/25] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:38:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:38:13.643670 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1591496201", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:38:13.683778 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bceaeebc-2447-4389-94c3-63c19efdf83f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:13.692665 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bceaeebc-2447-4389-94c3-63c19efdf83f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:13.694199 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bceaeebc-2447-4389-94c3-63c19efdf83f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:13.705516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-bceaeebc-2447-4389-94c3-63c19efdf83f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1281 microversion: 2.20 time: 0.205379 Jun 22 18:38:13.709544 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 16/26] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:13 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1281 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:13.764731 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-53d96ad5-ac7c-4394-9bc7-07f262b03218 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:13.765372 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-53d96ad5-ac7c-4394-9bc7-07f262b03218 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:13.778047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.network.neutron [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] validate_networks() for [('7fedf922-6bd0-4d18-856d-d78514e18614', None, None, None, None, None)] {{(pid=129743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:38:13.921774 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-53d96ad5-ac7c-4394-9bc7-07f262b03218 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:13.935415 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-53d96ad5-ac7c-4394-9bc7-07f262b03218 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1236 microversion: 2.1 time: 0.224650 Jun 22 18:38:13.940701 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 17/27] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:13 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1236 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:14.512159 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-441ed1da-3071-43d8-a49e-116bac13c83b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:14.512805 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-441ed1da-3071-43d8-a49e-116bac13c83b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:14.528956 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-441ed1da-3071-43d8-a49e-116bac13c83b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:14.533633 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-441ed1da-3071-43d8-a49e-116bac13c83b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:14.536409 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-441ed1da-3071-43d8-a49e-116bac13c83b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:14.537654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-441ed1da-3071-43d8-a49e-116bac13c83b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:14.660034 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-441ed1da-3071-43d8-a49e-116bac13c83b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:14.672531 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-441ed1da-3071-43d8-a49e-116bac13c83b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1267 microversion: 2.1 time: 0.161481 Jun 22 18:38:14.673475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 18/28] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:14 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:14.731034 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-254c8c1d-07c4-4339-a379-49b49fb5557a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:14.733792 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-254c8c1d-07c4-4339-a379-49b49fb5557a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:14.758582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-254c8c1d-07c4-4339-a379-49b49fb5557a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:14.760318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-254c8c1d-07c4-4339-a379-49b49fb5557a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:14.762919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-254c8c1d-07c4-4339-a379-49b49fb5557a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:14.764757 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-254c8c1d-07c4-4339-a379-49b49fb5557a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:14.913638 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-254c8c1d-07c4-4339-a379-49b49fb5557a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:14.928716 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-254c8c1d-07c4-4339-a379-49b49fb5557a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:14.930371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-254c8c1d-07c4-4339-a379-49b49fb5557a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:14.932185 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-254c8c1d-07c4-4339-a379-49b49fb5557a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1285 microversion: 2.20 time: 0.209713 Jun 22 18:38:14.943489 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 19/29] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:14 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:14.961116 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4523ef93-8aae-4ba2-a408-aec6ea548436 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:14.961902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4523ef93-8aae-4ba2-a408-aec6ea548436 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:14.975297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4523ef93-8aae-4ba2-a408-aec6ea548436 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:14.975749 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4523ef93-8aae-4ba2-a408-aec6ea548436 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:14.976559 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4523ef93-8aae-4ba2-a408-aec6ea548436 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:14.976995 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4523ef93-8aae-4ba2-a408-aec6ea548436 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:15.218129 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4523ef93-8aae-4ba2-a408-aec6ea548436 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:15.237046 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4523ef93-8aae-4ba2-a408-aec6ea548436 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1240 microversion: 2.1 time: 0.279640 Jun 22 18:38:15.240261 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 20/30] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:14 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1240 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:15.343997 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Flavor limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:38:15.345321 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Image limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:38:15.346132 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Flavor pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:38:15.346563 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Image pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:38:15.346985 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:38:15.359768 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:15.359768 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:15.360316 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:15.360979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:15.382367 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Getting quotas for project d866c4a659e74e42a3c37050eae82229. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:38:15.387021 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Getting quotas for user 94d5713dc97f442f916b22d925c35042 and project d866c4a659e74e42a3c37050eae82229. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:38:15.402131 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Going to run 1 instances... {{(pid=129743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:38:15.407216 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:38:15.505770 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-28109d6d-a88b-47fb-bbcd-5e4f3e45d842 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.880308 Jun 22 18:38:15.507036 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 11/31] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:38:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:38:15.520532 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1d203db2-fc11-4db6-ba1f-0dce46a8e010 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:15.521481 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-1d203db2-fc11-4db6-ba1f-0dce46a8e010 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:15.609047 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-1d203db2-fc11-4db6-ba1f-0dce46a8e010 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:15.620103 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-1d203db2-fc11-4db6-ba1f-0dce46a8e010 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1222 microversion: 2.1 time: 0.101290 Jun 22 18:38:15.620910 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 21/32] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:15 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:15.693032 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-0226d469-35ce-453a-bff1-5e826c86b300 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:15.694377 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0226d469-35ce-453a-bff1-5e826c86b300 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:15.736109 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0226d469-35ce-453a-bff1-5e826c86b300 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:15.738832 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0226d469-35ce-453a-bff1-5e826c86b300 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:15.740246 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0226d469-35ce-453a-bff1-5e826c86b300 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:15.741486 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0226d469-35ce-453a-bff1-5e826c86b300 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:15.951995 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-211d6a5b-4bff-4184-9219-d66579aa7628 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:15.952990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-211d6a5b-4bff-4184-9219-d66579aa7628 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:15.972547 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-211d6a5b-4bff-4184-9219-d66579aa7628 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:15.973341 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-211d6a5b-4bff-4184-9219-d66579aa7628 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:15.974334 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-211d6a5b-4bff-4184-9219-d66579aa7628 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:15.974972 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-211d6a5b-4bff-4184-9219-d66579aa7628 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:15.995460 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-0226d469-35ce-453a-bff1-5e826c86b300 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:16.016404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-0226d469-35ce-453a-bff1-5e826c86b300 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1267 microversion: 2.1 time: 0.328497 Jun 22 18:38:16.017258 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 12/33] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:15 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1267 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:16.078093 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-211d6a5b-4bff-4184-9219-d66579aa7628 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:16.088407 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-211d6a5b-4bff-4184-9219-d66579aa7628 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:16.089959 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-211d6a5b-4bff-4184-9219-d66579aa7628 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:16.092005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-211d6a5b-4bff-4184-9219-d66579aa7628 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1285 microversion: 2.20 time: 0.144996 Jun 22 18:38:16.093113 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 22/34] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:15 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:16.268622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e434463b-5c13-4df7-8a8c-1595b028e01f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:16.271203 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e434463b-5c13-4df7-8a8c-1595b028e01f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:16.281631 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e434463b-5c13-4df7-8a8c-1595b028e01f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:16.282231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e434463b-5c13-4df7-8a8c-1595b028e01f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:16.283155 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e434463b-5c13-4df7-8a8c-1595b028e01f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:16.284031 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e434463b-5c13-4df7-8a8c-1595b028e01f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:16.408573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e434463b-5c13-4df7-8a8c-1595b028e01f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:16.424226 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e434463b-5c13-4df7-8a8c-1595b028e01f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1240 microversion: 2.1 time: 0.167592 Jun 22 18:38:16.426282 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 13/35] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:16 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1240 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:16.638495 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ba5d3aea-f772-4b42-8e50-7ddfa2fbf046 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:16.639306 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ba5d3aea-f772-4b42-8e50-7ddfa2fbf046 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:16.647795 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ba5d3aea-f772-4b42-8e50-7ddfa2fbf046 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:16.648320 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ba5d3aea-f772-4b42-8e50-7ddfa2fbf046 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:16.650101 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ba5d3aea-f772-4b42-8e50-7ddfa2fbf046 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:16.650591 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ba5d3aea-f772-4b42-8e50-7ddfa2fbf046 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:16.730925 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ba5d3aea-f772-4b42-8e50-7ddfa2fbf046 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:16.740901 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ba5d3aea-f772-4b42-8e50-7ddfa2fbf046 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1226 microversion: 2.1 time: 0.106979 Jun 22 18:38:16.741661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 23/36] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:16 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:17.034578 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1dc4c29c-80bf-46e4-adb8-a27c43c12008 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:17.035406 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1dc4c29c-80bf-46e4-adb8-a27c43c12008 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:17.047167 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1dc4c29c-80bf-46e4-adb8-a27c43c12008 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:17.047620 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1dc4c29c-80bf-46e4-adb8-a27c43c12008 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:17.048777 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1dc4c29c-80bf-46e4-adb8-a27c43c12008 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:17.049409 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1dc4c29c-80bf-46e4-adb8-a27c43c12008 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:17.115967 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5966e9b9-4cd3-4d33-8bbb-5d7b2a5c478a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:17.116718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5966e9b9-4cd3-4d33-8bbb-5d7b2a5c478a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:17.125596 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5966e9b9-4cd3-4d33-8bbb-5d7b2a5c478a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:17.126056 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5966e9b9-4cd3-4d33-8bbb-5d7b2a5c478a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:17.127178 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5966e9b9-4cd3-4d33-8bbb-5d7b2a5c478a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:17.127776 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5966e9b9-4cd3-4d33-8bbb-5d7b2a5c478a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:17.136918 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1dc4c29c-80bf-46e4-adb8-a27c43c12008 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:17.146410 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1dc4c29c-80bf-46e4-adb8-a27c43c12008 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1267 microversion: 2.1 time: 0.115630 Jun 22 18:38:17.147524 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 14/37] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:17 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:17.210906 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5966e9b9-4cd3-4d33-8bbb-5d7b2a5c478a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:17.219788 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5966e9b9-4cd3-4d33-8bbb-5d7b2a5c478a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:17.221897 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5966e9b9-4cd3-4d33-8bbb-5d7b2a5c478a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:17.223044 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5966e9b9-4cd3-4d33-8bbb-5d7b2a5c478a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1285 microversion: 2.20 time: 0.112314 Jun 22 18:38:17.224124 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 24/38] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:17 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:17.445555 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d796e38f-0450-40e4-b17b-8016fd31154b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:17.447385 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d796e38f-0450-40e4-b17b-8016fd31154b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:17.470927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d796e38f-0450-40e4-b17b-8016fd31154b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:17.471622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d796e38f-0450-40e4-b17b-8016fd31154b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:17.472478 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d796e38f-0450-40e4-b17b-8016fd31154b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:17.473201 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d796e38f-0450-40e4-b17b-8016fd31154b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:17.574529 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d796e38f-0450-40e4-b17b-8016fd31154b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:17.587746 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d796e38f-0450-40e4-b17b-8016fd31154b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1240 microversion: 2.1 time: 0.147023 Jun 22 18:38:17.588375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 15/39] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:17 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1240 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:17.761115 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-bcc4a9c8-86fa-43da-86bb-25bce2658669 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:17.761725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-bcc4a9c8-86fa-43da-86bb-25bce2658669 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:17.781248 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bcc4a9c8-86fa-43da-86bb-25bce2658669 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:17.781677 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bcc4a9c8-86fa-43da-86bb-25bce2658669 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:17.784631 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bcc4a9c8-86fa-43da-86bb-25bce2658669 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:17.785241 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bcc4a9c8-86fa-43da-86bb-25bce2658669 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:17.919522 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bcc4a9c8-86fa-43da-86bb-25bce2658669 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:17.928172 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-bcc4a9c8-86fa-43da-86bb-25bce2658669 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1226 microversion: 2.1 time: 0.173449 Jun 22 18:38:17.931938 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 25/40] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:17 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1226 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:18.164549 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c852ffb1-6f2a-43dc-8980-e9ca972648ce tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:18.165778 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c852ffb1-6f2a-43dc-8980-e9ca972648ce tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:18.187106 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c852ffb1-6f2a-43dc-8980-e9ca972648ce tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:18.189022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c852ffb1-6f2a-43dc-8980-e9ca972648ce tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:18.190012 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c852ffb1-6f2a-43dc-8980-e9ca972648ce tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:18.193432 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c852ffb1-6f2a-43dc-8980-e9ca972648ce tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:18.256607 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7158f0ac-ac7c-402c-8a02-a215407ca25d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:18.258344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7158f0ac-ac7c-402c-8a02-a215407ca25d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:18.272973 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7158f0ac-ac7c-402c-8a02-a215407ca25d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:18.274598 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7158f0ac-ac7c-402c-8a02-a215407ca25d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:18.277387 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7158f0ac-ac7c-402c-8a02-a215407ca25d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:18.278730 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7158f0ac-ac7c-402c-8a02-a215407ca25d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:18.331574 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c852ffb1-6f2a-43dc-8980-e9ca972648ce tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:18.342734 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c852ffb1-6f2a-43dc-8980-e9ca972648ce tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1267 microversion: 2.1 time: 0.180616 Jun 22 18:38:18.345341 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 16/41] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:18 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:18.374153 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7158f0ac-ac7c-402c-8a02-a215407ca25d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:18.385277 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7158f0ac-ac7c-402c-8a02-a215407ca25d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:18.387243 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7158f0ac-ac7c-402c-8a02-a215407ca25d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:18.389172 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7158f0ac-ac7c-402c-8a02-a215407ca25d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1333 microversion: 2.20 time: 0.150082 Jun 22 18:38:18.390040 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 26/42] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:18 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1333 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:18.605509 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b77d306d-a393-44f0-9505-135e6dcc2a2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:18.606111 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b77d306d-a393-44f0-9505-135e6dcc2a2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:18.612991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b77d306d-a393-44f0-9505-135e6dcc2a2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:18.613441 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b77d306d-a393-44f0-9505-135e6dcc2a2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:18.614508 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b77d306d-a393-44f0-9505-135e6dcc2a2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:18.614957 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b77d306d-a393-44f0-9505-135e6dcc2a2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:18.684754 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b77d306d-a393-44f0-9505-135e6dcc2a2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:18.695184 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b77d306d-a393-44f0-9505-135e6dcc2a2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1288 microversion: 2.1 time: 0.093448 Jun 22 18:38:18.695763 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 17/43] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:18 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1288 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:18.952592 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f76a939a-ae8a-498c-8de7-58d254e36758 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:18.953372 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f76a939a-ae8a-498c-8de7-58d254e36758 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:18.965761 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f76a939a-ae8a-498c-8de7-58d254e36758 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:18.966698 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f76a939a-ae8a-498c-8de7-58d254e36758 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:18.967614 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f76a939a-ae8a-498c-8de7-58d254e36758 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:18.970403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f76a939a-ae8a-498c-8de7-58d254e36758 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:19.066421 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f76a939a-ae8a-498c-8de7-58d254e36758 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:19.075809 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f76a939a-ae8a-498c-8de7-58d254e36758 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1274 microversion: 2.1 time: 0.129050 Jun 22 18:38:19.076510 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 27/44] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:18 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1274 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:19.363720 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-30d1e15d-6130-46c2-ae25-dc8177732d0f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:19.364814 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-30d1e15d-6130-46c2-ae25-dc8177732d0f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:19.379380 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-30d1e15d-6130-46c2-ae25-dc8177732d0f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:19.381058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-30d1e15d-6130-46c2-ae25-dc8177732d0f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:19.383934 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-30d1e15d-6130-46c2-ae25-dc8177732d0f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:19.386593 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-30d1e15d-6130-46c2-ae25-dc8177732d0f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:19.409488 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5e2f89b1-0196-4afb-9e19-cf0eed546ebd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:19.410095 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5e2f89b1-0196-4afb-9e19-cf0eed546ebd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:19.424195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5e2f89b1-0196-4afb-9e19-cf0eed546ebd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:19.428245 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5e2f89b1-0196-4afb-9e19-cf0eed546ebd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:19.431720 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5e2f89b1-0196-4afb-9e19-cf0eed546ebd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:19.432348 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5e2f89b1-0196-4afb-9e19-cf0eed546ebd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:19.694473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-30d1e15d-6130-46c2-ae25-dc8177732d0f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:19.756836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-30d1e15d-6130-46c2-ae25-dc8177732d0f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1285 microversion: 2.1 time: 0.396629 Jun 22 18:38:19.761590 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 18/45] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:19 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1285 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:19.784454 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-32e5cb2d-a2f1-4447-abde-bf181aa093bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:19.793140 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-32e5cb2d-a2f1-4447-abde-bf181aa093bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:19.818005 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-32e5cb2d-a2f1-4447-abde-bf181aa093bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:19.820116 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-32e5cb2d-a2f1-4447-abde-bf181aa093bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:19.821589 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-32e5cb2d-a2f1-4447-abde-bf181aa093bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:19.824467 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-32e5cb2d-a2f1-4447-abde-bf181aa093bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:19.985516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5e2f89b1-0196-4afb-9e19-cf0eed546ebd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:20.003747 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5e2f89b1-0196-4afb-9e19-cf0eed546ebd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:20.005560 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5e2f89b1-0196-4afb-9e19-cf0eed546ebd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:20.006996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5e2f89b1-0196-4afb-9e19-cf0eed546ebd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1333 microversion: 2.20 time: 0.602093 Jun 22 18:38:20.012171 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-32e5cb2d-a2f1-4447-abde-bf181aa093bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:20.025292 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 28/46] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:19 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1333 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:20.030886 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-32e5cb2d-a2f1-4447-abde-bf181aa093bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1306 microversion: 2.1 time: 0.263854 Jun 22 18:38:20.031498 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 19/47] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:19 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1306 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:20.095170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b75046d7-02bd-46cd-93ec-dc184c7bcb4e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:20.095784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b75046d7-02bd-46cd-93ec-dc184c7bcb4e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:20.130010 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b75046d7-02bd-46cd-93ec-dc184c7bcb4e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:20.130467 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b75046d7-02bd-46cd-93ec-dc184c7bcb4e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:20.131245 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b75046d7-02bd-46cd-93ec-dc184c7bcb4e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:20.131847 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b75046d7-02bd-46cd-93ec-dc184c7bcb4e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:20.248449 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b75046d7-02bd-46cd-93ec-dc184c7bcb4e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:20.258611 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b75046d7-02bd-46cd-93ec-dc184c7bcb4e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.167845 Jun 22 18:38:20.259363 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 20/48] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:20 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:20.781487 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2bf995ba-a608-482d-9301-ab6c744ad4b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:20.782315 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2bf995ba-a608-482d-9301-ab6c744ad4b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:20.805361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2bf995ba-a608-482d-9301-ab6c744ad4b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:20.805846 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2bf995ba-a608-482d-9301-ab6c744ad4b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:20.808810 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2bf995ba-a608-482d-9301-ab6c744ad4b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:20.809407 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2bf995ba-a608-482d-9301-ab6c744ad4b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:21.028202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d0c553b2-e74f-4b4f-80fd-a8538c207d8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:21.029079 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d0c553b2-e74f-4b4f-80fd-a8538c207d8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:21.034404 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-2bf995ba-a608-482d-9301-ab6c744ad4b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:21.035589 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d0c553b2-e74f-4b4f-80fd-a8538c207d8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:21.036305 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d0c553b2-e74f-4b4f-80fd-a8538c207d8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:21.037780 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d0c553b2-e74f-4b4f-80fd-a8538c207d8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:21.038417 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d0c553b2-e74f-4b4f-80fd-a8538c207d8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:21.045186 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2bf995ba-a608-482d-9301-ab6c744ad4b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.269114 Jun 22 18:38:21.054679 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 29/49] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:20 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:21.054679 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-482c6776-5c2f-41f8-a69e-e0c648af6a13 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:21.054679 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-482c6776-5c2f-41f8-a69e-e0c648af6a13 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:21.064086 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-482c6776-5c2f-41f8-a69e-e0c648af6a13 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:21.064750 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-482c6776-5c2f-41f8-a69e-e0c648af6a13 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:21.065607 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-482c6776-5c2f-41f8-a69e-e0c648af6a13 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:21.066161 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-482c6776-5c2f-41f8-a69e-e0c648af6a13 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:21.114248 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d0c553b2-e74f-4b4f-80fd-a8538c207d8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:21.124116 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d0c553b2-e74f-4b4f-80fd-a8538c207d8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:21.125196 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d0c553b2-e74f-4b4f-80fd-a8538c207d8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:21.131485 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d0c553b2-e74f-4b4f-80fd-a8538c207d8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.109050 Jun 22 18:38:21.132418 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 21/50] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:21 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:21.159354 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-482c6776-5c2f-41f8-a69e-e0c648af6a13 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:21.170283 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-482c6776-5c2f-41f8-a69e-e0c648af6a13 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.122999 Jun 22 18:38:21.170903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 30/51] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:21 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:21.276357 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-75cf9a7f-7f92-4756-83ba-611a99d75536 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:21.277740 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-75cf9a7f-7f92-4756-83ba-611a99d75536 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:21.283910 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75cf9a7f-7f92-4756-83ba-611a99d75536 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:21.284417 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75cf9a7f-7f92-4756-83ba-611a99d75536 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:21.285220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75cf9a7f-7f92-4756-83ba-611a99d75536 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:21.285675 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75cf9a7f-7f92-4756-83ba-611a99d75536 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:21.350270 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-75cf9a7f-7f92-4756-83ba-611a99d75536 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:21.359061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-75cf9a7f-7f92-4756-83ba-611a99d75536 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.086437 Jun 22 18:38:21.359686 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 22/52] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:21 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:22.063431 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cad5e914-d048-4de0-a946-b7491a5ecf6a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:22.064063 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cad5e914-d048-4de0-a946-b7491a5ecf6a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:22.070085 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cad5e914-d048-4de0-a946-b7491a5ecf6a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:22.070522 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cad5e914-d048-4de0-a946-b7491a5ecf6a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:22.071273 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cad5e914-d048-4de0-a946-b7491a5ecf6a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:22.071700 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cad5e914-d048-4de0-a946-b7491a5ecf6a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:22.151038 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f832c191-2cf8-40ee-8718-facaaa45f0ad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:22.151651 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f832c191-2cf8-40ee-8718-facaaa45f0ad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:22.157974 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f832c191-2cf8-40ee-8718-facaaa45f0ad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:22.158425 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f832c191-2cf8-40ee-8718-facaaa45f0ad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:22.159197 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f832c191-2cf8-40ee-8718-facaaa45f0ad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:22.159635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f832c191-2cf8-40ee-8718-facaaa45f0ad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:22.211350 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cad5e914-d048-4de0-a946-b7491a5ecf6a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:22.219610 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cad5e914-d048-4de0-a946-b7491a5ecf6a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.160738 Jun 22 18:38:22.220211 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 31/53] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:22 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:22.221185 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f832c191-2cf8-40ee-8718-facaaa45f0ad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:22.224638 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b017bf17-a5ba-4b5c-822a-db9180640872 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:22.225388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b017bf17-a5ba-4b5c-822a-db9180640872 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:22.229813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f832c191-2cf8-40ee-8718-facaaa45f0ad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:22.231254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b017bf17-a5ba-4b5c-822a-db9180640872 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:22.231391 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f832c191-2cf8-40ee-8718-facaaa45f0ad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:22.232241 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b017bf17-a5ba-4b5c-822a-db9180640872 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:22.232487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f832c191-2cf8-40ee-8718-facaaa45f0ad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.085784 Jun 22 18:38:22.233192 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b017bf17-a5ba-4b5c-822a-db9180640872 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:22.233632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b017bf17-a5ba-4b5c-822a-db9180640872 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:22.233760 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 23/54] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:22 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:22.236436 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=4 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:22.303550 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b017bf17-a5ba-4b5c-822a-db9180640872 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:22.311510 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b017bf17-a5ba-4b5c-822a-db9180640872 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.090362 Jun 22 18:38:22.312106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 32/55] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:22 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:22.376425 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e21a76e5-d92a-497a-b075-495a2df34bc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:22.377041 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e21a76e5-d92a-497a-b075-495a2df34bc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:22.380059 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:22.384138 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e21a76e5-d92a-497a-b075-495a2df34bc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:22.384578 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e21a76e5-d92a-497a-b075-495a2df34bc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:22.385335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e21a76e5-d92a-497a-b075-495a2df34bc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:22.385760 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e21a76e5-d92a-497a-b075-495a2df34bc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:22.453058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e21a76e5-d92a-497a-b075-495a2df34bc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:22.460680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e21a76e5-d92a-497a-b075-495a2df34bc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.088718 Jun 22 18:38:22.461253 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 24/56] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:22 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:23.236334 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c3a0c01a-9bd5-4985-a36c-7fa4c2af3b7a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:23.236968 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c3a0c01a-9bd5-4985-a36c-7fa4c2af3b7a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:23.243126 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c3a0c01a-9bd5-4985-a36c-7fa4c2af3b7a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:23.243566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c3a0c01a-9bd5-4985-a36c-7fa4c2af3b7a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:23.244353 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c3a0c01a-9bd5-4985-a36c-7fa4c2af3b7a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:23.244784 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c3a0c01a-9bd5-4985-a36c-7fa4c2af3b7a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:23.250259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-39cd66f2-df68-498a-a6fc-c9c42f96e46e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:23.250855 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-39cd66f2-df68-498a-a6fc-c9c42f96e46e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:23.256782 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-39cd66f2-df68-498a-a6fc-c9c42f96e46e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:23.257218 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-39cd66f2-df68-498a-a6fc-c9c42f96e46e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:23.258213 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-39cd66f2-df68-498a-a6fc-c9c42f96e46e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:23.258638 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-39cd66f2-df68-498a-a6fc-c9c42f96e46e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:23.319251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-39cd66f2-df68-498a-a6fc-c9c42f96e46e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:23.327930 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-39cd66f2-df68-498a-a6fc-c9c42f96e46e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:23.329442 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-39cd66f2-df68-498a-a6fc-c9c42f96e46e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:23.330526 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-39cd66f2-df68-498a-a6fc-c9c42f96e46e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.084140 Jun 22 18:38:23.331070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 25/57] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:23 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:23.335438 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ef23f941-0538-466e-ad57-dc96b8895d3f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:23.336007 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ef23f941-0538-466e-ad57-dc96b8895d3f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:23.342681 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ef23f941-0538-466e-ad57-dc96b8895d3f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:23.343187 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ef23f941-0538-466e-ad57-dc96b8895d3f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:23.344075 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ef23f941-0538-466e-ad57-dc96b8895d3f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:23.344568 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ef23f941-0538-466e-ad57-dc96b8895d3f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:23.376932 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c3a0c01a-9bd5-4985-a36c-7fa4c2af3b7a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:23.380376 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=100 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:23.385709 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c3a0c01a-9bd5-4985-a36c-7fa4c2af3b7a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.153246 Jun 22 18:38:23.386274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 33/58] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:23 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:23.477994 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2c3a1342-3324-48fc-9ebe-3c1d22ac6619 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:23.478879 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2c3a1342-3324-48fc-9ebe-3c1d22ac6619 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:23.486133 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2c3a1342-3324-48fc-9ebe-3c1d22ac6619 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:23.486727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2c3a1342-3324-48fc-9ebe-3c1d22ac6619 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:23.487610 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2c3a1342-3324-48fc-9ebe-3c1d22ac6619 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:23.488299 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2c3a1342-3324-48fc-9ebe-3c1d22ac6619 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:23.541228 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ef23f941-0538-466e-ad57-dc96b8895d3f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:23.549042 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ef23f941-0538-466e-ad57-dc96b8895d3f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.217020 Jun 22 18:38:23.549935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 26/59] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:23 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:23.553103 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-2c3a1342-3324-48fc-9ebe-3c1d22ac6619 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:23.561108 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2c3a1342-3324-48fc-9ebe-3c1d22ac6619 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.087479 Jun 22 18:38:23.561660 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 34/60] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:23 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:24.348735 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a3d391e9-0dab-4a70-ac2e-5ab2708588f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:24.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a3d391e9-0dab-4a70-ac2e-5ab2708588f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:24.358708 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a3d391e9-0dab-4a70-ac2e-5ab2708588f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:24.359410 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a3d391e9-0dab-4a70-ac2e-5ab2708588f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:24.360220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a3d391e9-0dab-4a70-ac2e-5ab2708588f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:24.360803 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a3d391e9-0dab-4a70-ac2e-5ab2708588f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:24.380750 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:24.402363 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-670b2033-e28d-444e-b2ff-0dda30a8228c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:24.402952 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-670b2033-e28d-444e-b2ff-0dda30a8228c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:24.409635 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-670b2033-e28d-444e-b2ff-0dda30a8228c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:24.410721 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-670b2033-e28d-444e-b2ff-0dda30a8228c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:24.411542 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-670b2033-e28d-444e-b2ff-0dda30a8228c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:24.412023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-670b2033-e28d-444e-b2ff-0dda30a8228c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:24.461955 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a3d391e9-0dab-4a70-ac2e-5ab2708588f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:24.471986 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a3d391e9-0dab-4a70-ac2e-5ab2708588f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:24.473538 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a3d391e9-0dab-4a70-ac2e-5ab2708588f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:24.474855 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a3d391e9-0dab-4a70-ac2e-5ab2708588f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.129934 Jun 22 18:38:24.475441 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 27/61] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:24 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:24.566365 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c46687ca-b10a-4231-ae6d-1e7ae293bf41 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:24.567537 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c46687ca-b10a-4231-ae6d-1e7ae293bf41 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:24.575532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c46687ca-b10a-4231-ae6d-1e7ae293bf41 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:24.576239 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c46687ca-b10a-4231-ae6d-1e7ae293bf41 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:24.577441 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c46687ca-b10a-4231-ae6d-1e7ae293bf41 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:24.578012 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c46687ca-b10a-4231-ae6d-1e7ae293bf41 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:24.655072 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c46687ca-b10a-4231-ae6d-1e7ae293bf41 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:24.662097 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-670b2033-e28d-444e-b2ff-0dda30a8228c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:24.662980 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c46687ca-b10a-4231-ae6d-1e7ae293bf41 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.100990 Jun 22 18:38:24.663814 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 28/62] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:24 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:24.668668 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-59f135f2-94a8-42b7-9ab8-7149cc121d42 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:24.669960 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-59f135f2-94a8-42b7-9ab8-7149cc121d42 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:24.676917 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-59f135f2-94a8-42b7-9ab8-7149cc121d42 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:24.677415 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-59f135f2-94a8-42b7-9ab8-7149cc121d42 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:24.678280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-59f135f2-94a8-42b7-9ab8-7149cc121d42 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:24.678756 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-59f135f2-94a8-42b7-9ab8-7149cc121d42 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:24.688299 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-670b2033-e28d-444e-b2ff-0dda30a8228c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.288754 Jun 22 18:38:24.689713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 35/63] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:24 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:24.753397 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-59f135f2-94a8-42b7-9ab8-7149cc121d42 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:24.761096 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-59f135f2-94a8-42b7-9ab8-7149cc121d42 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.096447 Jun 22 18:38:24.761662 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 29/64] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:24 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:25.493100 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-114b77b1-9db1-4e58-b3c6-c8a7115cb52b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:25.494232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-114b77b1-9db1-4e58-b3c6-c8a7115cb52b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:25.502482 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-114b77b1-9db1-4e58-b3c6-c8a7115cb52b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:25.503378 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-114b77b1-9db1-4e58-b3c6-c8a7115cb52b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:25.504492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-114b77b1-9db1-4e58-b3c6-c8a7115cb52b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:25.505240 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-114b77b1-9db1-4e58-b3c6-c8a7115cb52b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:25.598346 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-114b77b1-9db1-4e58-b3c6-c8a7115cb52b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:25.609079 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-114b77b1-9db1-4e58-b3c6-c8a7115cb52b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:25.627926 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-114b77b1-9db1-4e58-b3c6-c8a7115cb52b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:25.627926 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-114b77b1-9db1-4e58-b3c6-c8a7115cb52b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.137773 Jun 22 18:38:25.627926 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 36/65] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:25 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:25.681559 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a2313db4-0136-4a38-93a4-13aaa8167cf5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:25.682260 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a2313db4-0136-4a38-93a4-13aaa8167cf5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:25.688702 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=6 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:25.690339 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=26 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:25.692541 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a2313db4-0136-4a38-93a4-13aaa8167cf5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:25.693220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a2313db4-0136-4a38-93a4-13aaa8167cf5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:25.694249 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a2313db4-0136-4a38-93a4-13aaa8167cf5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:25.694743 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a2313db4-0136-4a38-93a4-13aaa8167cf5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:25.706365 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1b69db61-20b0-4838-a656-e992dbafb2bb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:25.706967 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-1b69db61-20b0-4838-a656-e992dbafb2bb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:25.708953 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=24 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:25.717556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1b69db61-20b0-4838-a656-e992dbafb2bb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:25.718015 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1b69db61-20b0-4838-a656-e992dbafb2bb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:25.719859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1b69db61-20b0-4838-a656-e992dbafb2bb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:25.720591 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1b69db61-20b0-4838-a656-e992dbafb2bb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:25.773701 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a2313db4-0136-4a38-93a4-13aaa8167cf5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:25.784352 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a2313db4-0136-4a38-93a4-13aaa8167cf5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.106916 Jun 22 18:38:25.786105 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 30/66] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:25 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:25.791016 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1e3d99a9-2f77-4b0b-a1d0-7d911805c03c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:25.791703 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1e3d99a9-2f77-4b0b-a1d0-7d911805c03c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:25.800481 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1e3d99a9-2f77-4b0b-a1d0-7d911805c03c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:25.801189 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1e3d99a9-2f77-4b0b-a1d0-7d911805c03c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:25.802250 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1e3d99a9-2f77-4b0b-a1d0-7d911805c03c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:25.802924 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1e3d99a9-2f77-4b0b-a1d0-7d911805c03c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:25.876899 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1e3d99a9-2f77-4b0b-a1d0-7d911805c03c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:25.887877 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1e3d99a9-2f77-4b0b-a1d0-7d911805c03c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.100504 Jun 22 18:38:25.888710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 31/67] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:25 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:25.933242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-1b69db61-20b0-4838-a656-e992dbafb2bb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:25.942473 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-1b69db61-20b0-4838-a656-e992dbafb2bb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.239953 Jun 22 18:38:25.943145 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 37/68] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:25 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:26.647572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5cf8b3cd-fa8c-4624-960c-dc28a9a33d70 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:26.648226 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5cf8b3cd-fa8c-4624-960c-dc28a9a33d70 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:26.655187 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5cf8b3cd-fa8c-4624-960c-dc28a9a33d70 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:26.655712 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5cf8b3cd-fa8c-4624-960c-dc28a9a33d70 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:26.656494 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5cf8b3cd-fa8c-4624-960c-dc28a9a33d70 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:26.656918 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5cf8b3cd-fa8c-4624-960c-dc28a9a33d70 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:26.716234 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5cf8b3cd-fa8c-4624-960c-dc28a9a33d70 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:26.724557 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5cf8b3cd-fa8c-4624-960c-dc28a9a33d70 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:26.726065 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5cf8b3cd-fa8c-4624-960c-dc28a9a33d70 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:26.727141 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5cf8b3cd-fa8c-4624-960c-dc28a9a33d70 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.083421 Jun 22 18:38:26.727688 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 32/69] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:26 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:26.802044 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e10b7acb-2fbd-49df-a536-1ad1a07422bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:26.802645 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e10b7acb-2fbd-49df-a536-1ad1a07422bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:26.805708 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:26.810077 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e10b7acb-2fbd-49df-a536-1ad1a07422bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:26.810753 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e10b7acb-2fbd-49df-a536-1ad1a07422bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:26.812336 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e10b7acb-2fbd-49df-a536-1ad1a07422bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:26.812782 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e10b7acb-2fbd-49df-a536-1ad1a07422bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:26.882605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e10b7acb-2fbd-49df-a536-1ad1a07422bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:26.891316 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e10b7acb-2fbd-49df-a536-1ad1a07422bb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.093082 Jun 22 18:38:26.891887 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 38/70] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:26 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:26.905710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e3bb0493-b591-4522-850d-2b15fb1e2c14 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:26.906391 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e3bb0493-b591-4522-850d-2b15fb1e2c14 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:26.912590 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e3bb0493-b591-4522-850d-2b15fb1e2c14 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:26.912930 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e3bb0493-b591-4522-850d-2b15fb1e2c14 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:26.913691 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e3bb0493-b591-4522-850d-2b15fb1e2c14 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:26.914116 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e3bb0493-b591-4522-850d-2b15fb1e2c14 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:26.960604 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7bd25356-33bd-4e8d-b7bf-5f0dee9e0662 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:26.961246 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7bd25356-33bd-4e8d-b7bf-5f0dee9e0662 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:26.968054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7bd25356-33bd-4e8d-b7bf-5f0dee9e0662 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:26.968524 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7bd25356-33bd-4e8d-b7bf-5f0dee9e0662 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:26.969321 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7bd25356-33bd-4e8d-b7bf-5f0dee9e0662 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:26.969759 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7bd25356-33bd-4e8d-b7bf-5f0dee9e0662 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:26.978160 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e3bb0493-b591-4522-850d-2b15fb1e2c14 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:26.986302 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e3bb0493-b591-4522-850d-2b15fb1e2c14 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.085115 Jun 22 18:38:26.986871 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 33/71] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:26 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:27.102498 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7bd25356-33bd-4e8d-b7bf-5f0dee9e0662 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:27.110633 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7bd25356-33bd-4e8d-b7bf-5f0dee9e0662 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.153830 Jun 22 18:38:27.111196 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 39/72] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:26 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:27.746970 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-229857a7-c43b-48f7-bfd6-6c3df2453d73 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:27.747566 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-229857a7-c43b-48f7-bfd6-6c3df2453d73 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:27.762945 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-229857a7-c43b-48f7-bfd6-6c3df2453d73 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:27.763381 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-229857a7-c43b-48f7-bfd6-6c3df2453d73 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:27.764838 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-229857a7-c43b-48f7-bfd6-6c3df2453d73 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:27.765669 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-229857a7-c43b-48f7-bfd6-6c3df2453d73 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:27.849298 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-229857a7-c43b-48f7-bfd6-6c3df2453d73 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:27.857997 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-229857a7-c43b-48f7-bfd6-6c3df2453d73 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:27.859811 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-229857a7-c43b-48f7-bfd6-6c3df2453d73 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:27.864714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-229857a7-c43b-48f7-bfd6-6c3df2453d73 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.121717 Jun 22 18:38:27.865891 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 34/73] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:27 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:27.908862 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-36e4b0b4-c2ae-4fcf-9113-85ec01174fd2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:27.909943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-36e4b0b4-c2ae-4fcf-9113-85ec01174fd2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:27.916390 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-36e4b0b4-c2ae-4fcf-9113-85ec01174fd2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:27.916916 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-36e4b0b4-c2ae-4fcf-9113-85ec01174fd2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:27.917762 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-36e4b0b4-c2ae-4fcf-9113-85ec01174fd2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:27.918271 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-36e4b0b4-c2ae-4fcf-9113-85ec01174fd2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:28.004718 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4eee180a-5cd3-4ba6-93e8-afbc5e85ba8f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:28.005893 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-4eee180a-5cd3-4ba6-93e8-afbc5e85ba8f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:28.017131 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4eee180a-5cd3-4ba6-93e8-afbc5e85ba8f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:28.018085 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4eee180a-5cd3-4ba6-93e8-afbc5e85ba8f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:28.019226 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4eee180a-5cd3-4ba6-93e8-afbc5e85ba8f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:28.019760 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4eee180a-5cd3-4ba6-93e8-afbc5e85ba8f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:28.111679 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4eee180a-5cd3-4ba6-93e8-afbc5e85ba8f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:28.120142 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4eee180a-5cd3-4ba6-93e8-afbc5e85ba8f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.120341 Jun 22 18:38:28.128289 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 35/74] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:27 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:28.135065 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ac1e1d60-e6e2-4756-935f-0513e60e6c06 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:28.135677 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ac1e1d60-e6e2-4756-935f-0513e60e6c06 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:28.143156 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ac1e1d60-e6e2-4756-935f-0513e60e6c06 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:28.143858 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ac1e1d60-e6e2-4756-935f-0513e60e6c06 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:28.144666 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ac1e1d60-e6e2-4756-935f-0513e60e6c06 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:28.145270 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ac1e1d60-e6e2-4756-935f-0513e60e6c06 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:28.148244 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-36e4b0b4-c2ae-4fcf-9113-85ec01174fd2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:28.156585 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-36e4b0b4-c2ae-4fcf-9113-85ec01174fd2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.252282 Jun 22 18:38:28.157249 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 40/75] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:27 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:28.287585 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ac1e1d60-e6e2-4756-935f-0513e60e6c06 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:28.295574 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ac1e1d60-e6e2-4756-935f-0513e60e6c06 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.163985 Jun 22 18:38:28.296184 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 36/76] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:28 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:28.884075 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c3ca2a2a-f35b-4340-aa72-99b3647d85db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:28.885980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c3ca2a2a-f35b-4340-aa72-99b3647d85db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:28.891976 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c3ca2a2a-f35b-4340-aa72-99b3647d85db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:28.892524 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c3ca2a2a-f35b-4340-aa72-99b3647d85db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:28.893344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c3ca2a2a-f35b-4340-aa72-99b3647d85db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:28.893785 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c3ca2a2a-f35b-4340-aa72-99b3647d85db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:28.958455 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c3ca2a2a-f35b-4340-aa72-99b3647d85db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:28.967806 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c3ca2a2a-f35b-4340-aa72-99b3647d85db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:28.969157 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c3ca2a2a-f35b-4340-aa72-99b3647d85db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:28.970241 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c3ca2a2a-f35b-4340-aa72-99b3647d85db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.090399 Jun 22 18:38:28.970783 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 41/77] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:28 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:29.138112 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f990668a-8d67-4cac-bcf2-d9db33bb5337 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:29.140782 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f990668a-8d67-4cac-bcf2-d9db33bb5337 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:29.147928 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f990668a-8d67-4cac-bcf2-d9db33bb5337 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:29.148375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f990668a-8d67-4cac-bcf2-d9db33bb5337 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:29.149156 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f990668a-8d67-4cac-bcf2-d9db33bb5337 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:29.149585 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f990668a-8d67-4cac-bcf2-d9db33bb5337 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:29.174325 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0b3dd14c-3268-4f77-9862-ad57c6564f14 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:29.174877 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0b3dd14c-3268-4f77-9862-ad57c6564f14 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:29.181358 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0b3dd14c-3268-4f77-9862-ad57c6564f14 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:29.181799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0b3dd14c-3268-4f77-9862-ad57c6564f14 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:29.182571 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0b3dd14c-3268-4f77-9862-ad57c6564f14 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:29.183003 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0b3dd14c-3268-4f77-9862-ad57c6564f14 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:29.219777 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f990668a-8d67-4cac-bcf2-d9db33bb5337 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:29.227314 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f990668a-8d67-4cac-bcf2-d9db33bb5337 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.093507 Jun 22 18:38:29.227901 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 37/78] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:29 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:29.249027 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0b3dd14c-3268-4f77-9862-ad57c6564f14 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:29.257231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0b3dd14c-3268-4f77-9862-ad57c6564f14 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.087392 Jun 22 18:38:29.257810 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 42/79] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:29 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:29.312834 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a9a4d328-a8c9-4b50-97e1-c92a56309d1e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:29.313444 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a9a4d328-a8c9-4b50-97e1-c92a56309d1e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:29.319423 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a9a4d328-a8c9-4b50-97e1-c92a56309d1e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:29.319904 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a9a4d328-a8c9-4b50-97e1-c92a56309d1e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:29.320666 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a9a4d328-a8c9-4b50-97e1-c92a56309d1e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:29.321093 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a9a4d328-a8c9-4b50-97e1-c92a56309d1e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:29.471757 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a9a4d328-a8c9-4b50-97e1-c92a56309d1e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:29.479325 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a9a4d328-a8c9-4b50-97e1-c92a56309d1e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.170883 Jun 22 18:38:29.480101 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 38/80] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:29 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:29.989340 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cc2a5081-42d7-4c3b-8657-97b5fd09bf1b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:29.989932 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cc2a5081-42d7-4c3b-8657-97b5fd09bf1b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:29.996201 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc2a5081-42d7-4c3b-8657-97b5fd09bf1b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:29.996655 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc2a5081-42d7-4c3b-8657-97b5fd09bf1b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:29.997423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc2a5081-42d7-4c3b-8657-97b5fd09bf1b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:29.998525 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc2a5081-42d7-4c3b-8657-97b5fd09bf1b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:30.061173 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cc2a5081-42d7-4c3b-8657-97b5fd09bf1b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:30.069402 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cc2a5081-42d7-4c3b-8657-97b5fd09bf1b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:30.070916 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cc2a5081-42d7-4c3b-8657-97b5fd09bf1b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:30.072045 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cc2a5081-42d7-4c3b-8657-97b5fd09bf1b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.086607 Jun 22 18:38:30.072602 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 43/81] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:29 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:30.244163 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3841619b-2456-4484-8d69-bfca1cd59726 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:30.244773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3841619b-2456-4484-8d69-bfca1cd59726 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:30.250956 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3841619b-2456-4484-8d69-bfca1cd59726 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:30.251404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3841619b-2456-4484-8d69-bfca1cd59726 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:30.252195 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3841619b-2456-4484-8d69-bfca1cd59726 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:30.252634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3841619b-2456-4484-8d69-bfca1cd59726 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:30.275615 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a696ede7-081f-4c94-b778-cfcde4c9dfa2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:30.276246 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a696ede7-081f-4c94-b778-cfcde4c9dfa2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:30.282748 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a696ede7-081f-4c94-b778-cfcde4c9dfa2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:30.283193 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a696ede7-081f-4c94-b778-cfcde4c9dfa2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:30.284168 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a696ede7-081f-4c94-b778-cfcde4c9dfa2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:30.284594 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a696ede7-081f-4c94-b778-cfcde4c9dfa2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:30.314734 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3841619b-2456-4484-8d69-bfca1cd59726 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:30.322443 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3841619b-2456-4484-8d69-bfca1cd59726 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.082133 Jun 22 18:38:30.323016 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 39/82] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:30 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:30.349359 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a696ede7-081f-4c94-b778-cfcde4c9dfa2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:30.356748 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a696ede7-081f-4c94-b778-cfcde4c9dfa2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.084880 Jun 22 18:38:30.358017 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 44/83] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:30 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:30.496212 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6d70a123-a3e6-424d-98b2-0f1585f3b616 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:30.496817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6d70a123-a3e6-424d-98b2-0f1585f3b616 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:30.502846 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6d70a123-a3e6-424d-98b2-0f1585f3b616 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:30.503288 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6d70a123-a3e6-424d-98b2-0f1585f3b616 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:30.504071 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6d70a123-a3e6-424d-98b2-0f1585f3b616 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:30.504506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6d70a123-a3e6-424d-98b2-0f1585f3b616 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:30.638403 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6d70a123-a3e6-424d-98b2-0f1585f3b616 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:30.646176 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6d70a123-a3e6-424d-98b2-0f1585f3b616 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.153689 Jun 22 18:38:30.646961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 40/84] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:30 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:31.089527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a7083a3a-cc0d-4e47-8a35-1022c2ee5040 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:31.090269 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a7083a3a-cc0d-4e47-8a35-1022c2ee5040 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:31.097765 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a7083a3a-cc0d-4e47-8a35-1022c2ee5040 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:31.098142 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a7083a3a-cc0d-4e47-8a35-1022c2ee5040 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:31.098917 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a7083a3a-cc0d-4e47-8a35-1022c2ee5040 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:31.099349 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a7083a3a-cc0d-4e47-8a35-1022c2ee5040 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:31.168811 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a7083a3a-cc0d-4e47-8a35-1022c2ee5040 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:31.178091 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a7083a3a-cc0d-4e47-8a35-1022c2ee5040 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:31.179695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a7083a3a-cc0d-4e47-8a35-1022c2ee5040 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:31.180893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a7083a3a-cc0d-4e47-8a35-1022c2ee5040 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.095541 Jun 22 18:38:31.188464 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 45/85] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:31 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:31.338343 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2026ac95-f4bf-456c-86a0-e43cef6ac5e3 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:31.338946 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2026ac95-f4bf-456c-86a0-e43cef6ac5e3 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:31.345872 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2026ac95-f4bf-456c-86a0-e43cef6ac5e3 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:31.346309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2026ac95-f4bf-456c-86a0-e43cef6ac5e3 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:31.347089 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2026ac95-f4bf-456c-86a0-e43cef6ac5e3 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:31.347518 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2026ac95-f4bf-456c-86a0-e43cef6ac5e3 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:31.374925 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-fd44b859-e3c7-4d24-9cf9-93fda4953062 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:31.375453 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-fd44b859-e3c7-4d24-9cf9-93fda4953062 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:31.384098 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fd44b859-e3c7-4d24-9cf9-93fda4953062 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:31.384619 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fd44b859-e3c7-4d24-9cf9-93fda4953062 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:31.385582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fd44b859-e3c7-4d24-9cf9-93fda4953062 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:31.386304 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fd44b859-e3c7-4d24-9cf9-93fda4953062 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:31.431042 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2026ac95-f4bf-456c-86a0-e43cef6ac5e3 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:31.440418 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2026ac95-f4bf-456c-86a0-e43cef6ac5e3 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.105620 Jun 22 18:38:31.441006 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 41/86] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:31 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:31.464224 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fd44b859-e3c7-4d24-9cf9-93fda4953062 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:31.475292 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-fd44b859-e3c7-4d24-9cf9-93fda4953062 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.105111 Jun 22 18:38:31.476113 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 46/87] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:31 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:31.664627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d10f9f5c-7305-40a4-b049-9d2e6acc544b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:31.665736 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d10f9f5c-7305-40a4-b049-9d2e6acc544b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:31.673863 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d10f9f5c-7305-40a4-b049-9d2e6acc544b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:31.674339 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d10f9f5c-7305-40a4-b049-9d2e6acc544b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:31.675157 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d10f9f5c-7305-40a4-b049-9d2e6acc544b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:31.675778 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d10f9f5c-7305-40a4-b049-9d2e6acc544b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:31.853435 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d10f9f5c-7305-40a4-b049-9d2e6acc544b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:31.862188 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d10f9f5c-7305-40a4-b049-9d2e6acc544b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.202693 Jun 22 18:38:31.862903 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 42/88] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:31 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:32.198904 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-597744aa-95d1-4915-b798-4a52c8fc82b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:32.201780 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-597744aa-95d1-4915-b798-4a52c8fc82b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:32.210230 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-597744aa-95d1-4915-b798-4a52c8fc82b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:32.210909 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-597744aa-95d1-4915-b798-4a52c8fc82b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:32.212148 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-597744aa-95d1-4915-b798-4a52c8fc82b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:32.213313 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-597744aa-95d1-4915-b798-4a52c8fc82b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:32.333552 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-597744aa-95d1-4915-b798-4a52c8fc82b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:32.347864 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-597744aa-95d1-4915-b798-4a52c8fc82b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:32.349646 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-597744aa-95d1-4915-b798-4a52c8fc82b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:32.350991 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-597744aa-95d1-4915-b798-4a52c8fc82b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.156094 Jun 22 18:38:32.363690 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 47/89] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:32 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:32.458965 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e2d6b3f0-3dc5-49b5-b66f-6622b3ff3113 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:32.464343 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e2d6b3f0-3dc5-49b5-b66f-6622b3ff3113 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:32.474878 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e2d6b3f0-3dc5-49b5-b66f-6622b3ff3113 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:32.475329 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e2d6b3f0-3dc5-49b5-b66f-6622b3ff3113 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:32.476150 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e2d6b3f0-3dc5-49b5-b66f-6622b3ff3113 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:32.476587 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e2d6b3f0-3dc5-49b5-b66f-6622b3ff3113 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:32.494403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8990d4b2-4d4a-4093-b984-544b6e561ec7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:32.495697 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8990d4b2-4d4a-4093-b984-544b6e561ec7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:32.506945 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8990d4b2-4d4a-4093-b984-544b6e561ec7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:32.507372 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8990d4b2-4d4a-4093-b984-544b6e561ec7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:32.510383 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8990d4b2-4d4a-4093-b984-544b6e561ec7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:32.511623 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8990d4b2-4d4a-4093-b984-544b6e561ec7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:32.597911 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e2d6b3f0-3dc5-49b5-b66f-6622b3ff3113 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:32.606730 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e2d6b3f0-3dc5-49b5-b66f-6622b3ff3113 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.152680 Jun 22 18:38:32.617566 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 43/90] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:32 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:32.621577 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8990d4b2-4d4a-4093-b984-544b6e561ec7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:32.650779 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8990d4b2-4d4a-4093-b984-544b6e561ec7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.152789 Jun 22 18:38:32.651771 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 48/91] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:32 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:32.880205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-93021c75-cce9-47f5-8b77-7c874c1e6bf6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:32.881301 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-93021c75-cce9-47f5-8b77-7c874c1e6bf6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:32.890480 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-93021c75-cce9-47f5-8b77-7c874c1e6bf6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:32.892141 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-93021c75-cce9-47f5-8b77-7c874c1e6bf6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:32.893239 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-93021c75-cce9-47f5-8b77-7c874c1e6bf6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:32.894036 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-93021c75-cce9-47f5-8b77-7c874c1e6bf6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:32.901047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:33.067075 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-93021c75-cce9-47f5-8b77-7c874c1e6bf6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:33.076932 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-93021c75-cce9-47f5-8b77-7c874c1e6bf6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.201801 Jun 22 18:38:33.077866 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 44/92] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:32 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:33.370451 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9fcc24f7-0d5b-429e-b29a-f0c0d295656f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:33.371054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9fcc24f7-0d5b-429e-b29a-f0c0d295656f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:33.377126 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9fcc24f7-0d5b-429e-b29a-f0c0d295656f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:33.377562 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9fcc24f7-0d5b-429e-b29a-f0c0d295656f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:33.378321 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9fcc24f7-0d5b-429e-b29a-f0c0d295656f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:33.378750 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9fcc24f7-0d5b-429e-b29a-f0c0d295656f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:33.454191 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9fcc24f7-0d5b-429e-b29a-f0c0d295656f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:33.463728 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9fcc24f7-0d5b-429e-b29a-f0c0d295656f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:33.465435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9fcc24f7-0d5b-429e-b29a-f0c0d295656f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:33.467346 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9fcc24f7-0d5b-429e-b29a-f0c0d295656f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.100073 Jun 22 18:38:33.467346 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 49/93] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:33 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:33.625312 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-91f9eaf9-2816-4904-9d7d-3dbff26b9aec tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:33.626550 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-91f9eaf9-2816-4904-9d7d-3dbff26b9aec tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:33.632512 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91f9eaf9-2816-4904-9d7d-3dbff26b9aec tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:33.633263 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91f9eaf9-2816-4904-9d7d-3dbff26b9aec tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:33.634025 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91f9eaf9-2816-4904-9d7d-3dbff26b9aec tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:33.634449 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91f9eaf9-2816-4904-9d7d-3dbff26b9aec tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:33.668685 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-bc058d19-f493-442c-812d-4000bf4887ad tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:33.669440 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-bc058d19-f493-442c-812d-4000bf4887ad tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:33.680243 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bc058d19-f493-442c-812d-4000bf4887ad tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:33.682599 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bc058d19-f493-442c-812d-4000bf4887ad tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:33.683740 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bc058d19-f493-442c-812d-4000bf4887ad tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:33.684540 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bc058d19-f493-442c-812d-4000bf4887ad tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:33.705504 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=100 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:33.710348 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-91f9eaf9-2816-4904-9d7d-3dbff26b9aec tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:33.719543 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-91f9eaf9-2816-4904-9d7d-3dbff26b9aec tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.098869 Jun 22 18:38:33.720508 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 45/94] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:33 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:33.763617 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bc058d19-f493-442c-812d-4000bf4887ad tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:33.771211 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-bc058d19-f493-442c-812d-4000bf4887ad tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.106589 Jun 22 18:38:33.771782 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 50/95] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:33 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:34.094069 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a2fd3730-c7c1-40c7-973b-0cf86846ff47 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:34.094789 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a2fd3730-c7c1-40c7-973b-0cf86846ff47 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:34.101063 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a2fd3730-c7c1-40c7-973b-0cf86846ff47 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:34.101507 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a2fd3730-c7c1-40c7-973b-0cf86846ff47 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:34.102270 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a2fd3730-c7c1-40c7-973b-0cf86846ff47 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:34.102705 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a2fd3730-c7c1-40c7-973b-0cf86846ff47 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:34.258790 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a2fd3730-c7c1-40c7-973b-0cf86846ff47 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:34.267070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a2fd3730-c7c1-40c7-973b-0cf86846ff47 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.177637 Jun 22 18:38:34.267627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 46/96] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:34 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:34.484995 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-08035626-ab0e-43f9-9297-63ad1235e731 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:34.485601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-08035626-ab0e-43f9-9297-63ad1235e731 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:34.491620 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-08035626-ab0e-43f9-9297-63ad1235e731 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:34.492098 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-08035626-ab0e-43f9-9297-63ad1235e731 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:34.492865 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-08035626-ab0e-43f9-9297-63ad1235e731 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:34.493299 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-08035626-ab0e-43f9-9297-63ad1235e731 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:34.556339 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-08035626-ab0e-43f9-9297-63ad1235e731 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:34.565145 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-08035626-ab0e-43f9-9297-63ad1235e731 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:34.566659 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-08035626-ab0e-43f9-9297-63ad1235e731 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:34.567751 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-08035626-ab0e-43f9-9297-63ad1235e731 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.087209 Jun 22 18:38:34.568337 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 51/97] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:34 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:34.736324 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-be2f67ae-11ea-4227-9472-872135f32cc0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:34.736893 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-be2f67ae-11ea-4227-9472-872135f32cc0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:34.742888 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-be2f67ae-11ea-4227-9472-872135f32cc0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:34.743326 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-be2f67ae-11ea-4227-9472-872135f32cc0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:34.744095 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-be2f67ae-11ea-4227-9472-872135f32cc0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:34.744519 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-be2f67ae-11ea-4227-9472-872135f32cc0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:34.789060 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d2166206-4edb-4a87-9069-c4199792643d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:34.789658 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d2166206-4edb-4a87-9069-c4199792643d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:34.796868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d2166206-4edb-4a87-9069-c4199792643d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:34.797335 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d2166206-4edb-4a87-9069-c4199792643d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:34.798087 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d2166206-4edb-4a87-9069-c4199792643d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:34.798512 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d2166206-4edb-4a87-9069-c4199792643d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:34.806963 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-be2f67ae-11ea-4227-9472-872135f32cc0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:34.814687 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-be2f67ae-11ea-4227-9472-872135f32cc0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.082967 Jun 22 18:38:34.815339 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 47/98] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:34 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:34.861650 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d2166206-4edb-4a87-9069-c4199792643d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:34.869053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d2166206-4edb-4a87-9069-c4199792643d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.083888 Jun 22 18:38:34.869599 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 52/99] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:34 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:35.284262 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6d1ce41c-41d7-4eaa-a426-7c356a1ee470 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:35.284869 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6d1ce41c-41d7-4eaa-a426-7c356a1ee470 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:35.290806 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6d1ce41c-41d7-4eaa-a426-7c356a1ee470 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:35.291244 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6d1ce41c-41d7-4eaa-a426-7c356a1ee470 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:35.292035 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6d1ce41c-41d7-4eaa-a426-7c356a1ee470 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:35.292473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6d1ce41c-41d7-4eaa-a426-7c356a1ee470 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:35.442373 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6d1ce41c-41d7-4eaa-a426-7c356a1ee470 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:35.450176 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6d1ce41c-41d7-4eaa-a426-7c356a1ee470 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.169595 Jun 22 18:38:35.460150 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 48/100] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:35 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:35.585462 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-024854a1-4d00-49cb-9258-0c07354a893a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:35.586055 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-024854a1-4d00-49cb-9258-0c07354a893a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:35.592437 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-024854a1-4d00-49cb-9258-0c07354a893a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:35.592885 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-024854a1-4d00-49cb-9258-0c07354a893a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:35.593645 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-024854a1-4d00-49cb-9258-0c07354a893a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:35.594071 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-024854a1-4d00-49cb-9258-0c07354a893a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:35.665367 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-024854a1-4d00-49cb-9258-0c07354a893a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:35.675266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-024854a1-4d00-49cb-9258-0c07354a893a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:35.676991 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-024854a1-4d00-49cb-9258-0c07354a893a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:35.678142 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-024854a1-4d00-49cb-9258-0c07354a893a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.096554 Jun 22 18:38:35.678692 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 53/101] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:35 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:35.831394 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c6b738be-78e5-47b9-ac30-22562ccf8226 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:35.832024 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c6b738be-78e5-47b9-ac30-22562ccf8226 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:35.838203 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c6b738be-78e5-47b9-ac30-22562ccf8226 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:35.838636 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c6b738be-78e5-47b9-ac30-22562ccf8226 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:35.839385 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c6b738be-78e5-47b9-ac30-22562ccf8226 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:35.839816 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c6b738be-78e5-47b9-ac30-22562ccf8226 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:35.885414 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8df3a884-57f0-4615-b2b9-511a8ce117e8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:35.885943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8df3a884-57f0-4615-b2b9-511a8ce117e8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:35.892724 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8df3a884-57f0-4615-b2b9-511a8ce117e8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:35.893175 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8df3a884-57f0-4615-b2b9-511a8ce117e8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:35.893948 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8df3a884-57f0-4615-b2b9-511a8ce117e8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:35.894385 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8df3a884-57f0-4615-b2b9-511a8ce117e8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:35.906175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c6b738be-78e5-47b9-ac30-22562ccf8226 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:35.913738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c6b738be-78e5-47b9-ac30-22562ccf8226 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.086155 Jun 22 18:38:35.914301 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 49/102] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:35 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:35.956298 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8df3a884-57f0-4615-b2b9-511a8ce117e8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:35.963677 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8df3a884-57f0-4615-b2b9-511a8ce117e8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.082416 Jun 22 18:38:35.964272 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 54/103] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:35 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:36.468033 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b5a58f78-b6ed-4668-8d46-698dc5c93dc9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:36.468638 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b5a58f78-b6ed-4668-8d46-698dc5c93dc9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:36.474672 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b5a58f78-b6ed-4668-8d46-698dc5c93dc9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:36.475192 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b5a58f78-b6ed-4668-8d46-698dc5c93dc9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:36.476126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b5a58f78-b6ed-4668-8d46-698dc5c93dc9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:36.476670 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b5a58f78-b6ed-4668-8d46-698dc5c93dc9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:36.605459 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b5a58f78-b6ed-4668-8d46-698dc5c93dc9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:36.613641 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b5a58f78-b6ed-4668-8d46-698dc5c93dc9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.149826 Jun 22 18:38:36.614207 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 50/104] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:36 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:36.696482 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cec90dc3-e9f3-4880-b185-bdfc141ba485 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:36.697073 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cec90dc3-e9f3-4880-b185-bdfc141ba485 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:36.703948 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cec90dc3-e9f3-4880-b185-bdfc141ba485 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:36.704392 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cec90dc3-e9f3-4880-b185-bdfc141ba485 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:36.705176 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cec90dc3-e9f3-4880-b185-bdfc141ba485 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:36.705599 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cec90dc3-e9f3-4880-b185-bdfc141ba485 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:36.766514 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cec90dc3-e9f3-4880-b185-bdfc141ba485 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:36.774553 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cec90dc3-e9f3-4880-b185-bdfc141ba485 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:36.776085 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cec90dc3-e9f3-4880-b185-bdfc141ba485 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:36.777203 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cec90dc3-e9f3-4880-b185-bdfc141ba485 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.084638 Jun 22 18:38:36.777741 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 55/105] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:36 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:36.931028 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3dff9dd6-e9fc-46a0-93ae-633e7439d158 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:36.931634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3dff9dd6-e9fc-46a0-93ae-633e7439d158 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:36.938593 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3dff9dd6-e9fc-46a0-93ae-633e7439d158 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:36.939037 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3dff9dd6-e9fc-46a0-93ae-633e7439d158 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:36.939794 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3dff9dd6-e9fc-46a0-93ae-633e7439d158 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:36.940257 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3dff9dd6-e9fc-46a0-93ae-633e7439d158 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:36.981234 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-555ed05e-b23c-43f4-a80e-24e603863214 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:36.981990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-555ed05e-b23c-43f4-a80e-24e603863214 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:36.988765 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-555ed05e-b23c-43f4-a80e-24e603863214 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:36.989288 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-555ed05e-b23c-43f4-a80e-24e603863214 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:36.990121 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-555ed05e-b23c-43f4-a80e-24e603863214 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:36.990643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-555ed05e-b23c-43f4-a80e-24e603863214 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:37.000725 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3dff9dd6-e9fc-46a0-93ae-633e7439d158 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:37.008511 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3dff9dd6-e9fc-46a0-93ae-633e7439d158 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.081168 Jun 22 18:38:37.009083 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 51/106] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:36 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:37.055194 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-555ed05e-b23c-43f4-a80e-24e603863214 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:37.063570 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-555ed05e-b23c-43f4-a80e-24e603863214 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.086246 Jun 22 18:38:37.064168 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 56/107] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:36 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:37.630391 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-0b57ea4a-3a08-467d-b367-b27dfeac4334 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:37.630996 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0b57ea4a-3a08-467d-b367-b27dfeac4334 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:37.637256 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0b57ea4a-3a08-467d-b367-b27dfeac4334 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:37.637715 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0b57ea4a-3a08-467d-b367-b27dfeac4334 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:37.638583 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0b57ea4a-3a08-467d-b367-b27dfeac4334 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:37.639016 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0b57ea4a-3a08-467d-b367-b27dfeac4334 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:37.766731 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-0b57ea4a-3a08-467d-b367-b27dfeac4334 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:37.774224 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-0b57ea4a-3a08-467d-b367-b27dfeac4334 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.147574 Jun 22 18:38:37.774731 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 52/108] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:37 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:37.796147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-06b3c878-087f-4fbc-84de-83a5a64403f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:37.796741 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-06b3c878-087f-4fbc-84de-83a5a64403f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:37.802770 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-06b3c878-087f-4fbc-84de-83a5a64403f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:37.803204 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-06b3c878-087f-4fbc-84de-83a5a64403f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:37.804003 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-06b3c878-087f-4fbc-84de-83a5a64403f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:37.804432 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-06b3c878-087f-4fbc-84de-83a5a64403f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:37.869011 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-06b3c878-087f-4fbc-84de-83a5a64403f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:37.877987 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-06b3c878-087f-4fbc-84de-83a5a64403f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:37.879498 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-06b3c878-087f-4fbc-84de-83a5a64403f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:37.880616 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-06b3c878-087f-4fbc-84de-83a5a64403f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.089024 Jun 22 18:38:37.881168 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 57/109] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:37 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:38.026340 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-66bf2bf2-11ef-42e2-872a-0a556e840db7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:38.027666 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-66bf2bf2-11ef-42e2-872a-0a556e840db7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:38.035220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-66bf2bf2-11ef-42e2-872a-0a556e840db7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:38.035665 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-66bf2bf2-11ef-42e2-872a-0a556e840db7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:38.036682 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-66bf2bf2-11ef-42e2-872a-0a556e840db7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:38.037207 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-66bf2bf2-11ef-42e2-872a-0a556e840db7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:38.081871 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f3a9f667-1069-4fcf-9ff3-d80ef3755759 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:38.082485 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f3a9f667-1069-4fcf-9ff3-d80ef3755759 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:38.088721 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f3a9f667-1069-4fcf-9ff3-d80ef3755759 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:38.089168 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f3a9f667-1069-4fcf-9ff3-d80ef3755759 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:38.089932 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f3a9f667-1069-4fcf-9ff3-d80ef3755759 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:38.090368 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f3a9f667-1069-4fcf-9ff3-d80ef3755759 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:38.124458 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-66bf2bf2-11ef-42e2-872a-0a556e840db7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:38.132049 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-66bf2bf2-11ef-42e2-872a-0a556e840db7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1280 microversion: 2.1 time: 0.109786 Jun 22 18:38:38.132622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 53/110] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:38 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1280 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:38.164833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f3a9f667-1069-4fcf-9ff3-d80ef3755759 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:38.176529 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f3a9f667-1069-4fcf-9ff3-d80ef3755759 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.098767 Jun 22 18:38:38.177138 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 58/111] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:38 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:38.791940 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-25107002-eecb-4ab9-9b89-1ebcf70460e0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:38.792503 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-25107002-eecb-4ab9-9b89-1ebcf70460e0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:38.798595 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-25107002-eecb-4ab9-9b89-1ebcf70460e0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:38.799042 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-25107002-eecb-4ab9-9b89-1ebcf70460e0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:38.799816 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-25107002-eecb-4ab9-9b89-1ebcf70460e0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:38.800273 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-25107002-eecb-4ab9-9b89-1ebcf70460e0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:38.900545 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-135ae03c-ca2c-4349-9859-2a08cb3eb347 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:38.901870 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-135ae03c-ca2c-4349-9859-2a08cb3eb347 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:38.911287 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-135ae03c-ca2c-4349-9859-2a08cb3eb347 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:38.912033 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-135ae03c-ca2c-4349-9859-2a08cb3eb347 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:38.912976 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-135ae03c-ca2c-4349-9859-2a08cb3eb347 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:38.913408 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-135ae03c-ca2c-4349-9859-2a08cb3eb347 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:39.104570 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-135ae03c-ca2c-4349-9859-2a08cb3eb347 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:39.118481 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-135ae03c-ca2c-4349-9859-2a08cb3eb347 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:39.120571 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-135ae03c-ca2c-4349-9859-2a08cb3eb347 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:39.121975 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-135ae03c-ca2c-4349-9859-2a08cb3eb347 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1339 microversion: 2.20 time: 0.227183 Jun 22 18:38:39.135305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 59/112] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:38 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1339 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:39.150948 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-737f8034-7d38-4047-9c1b-a18e0d74d44e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:39.151848 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-737f8034-7d38-4047-9c1b-a18e0d74d44e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:39.159693 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-737f8034-7d38-4047-9c1b-a18e0d74d44e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:39.160282 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-737f8034-7d38-4047-9c1b-a18e0d74d44e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:39.161345 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-737f8034-7d38-4047-9c1b-a18e0d74d44e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:39.162026 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-737f8034-7d38-4047-9c1b-a18e0d74d44e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:39.272253 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-25107002-eecb-4ab9-9b89-1ebcf70460e0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:39.295865 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-25107002-eecb-4ab9-9b89-1ebcf70460e0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.505187 Jun 22 18:38:39.299257 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 54/113] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:38 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:39.306422 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7ef3f695-50ef-409b-8091-f7ef56bbb567 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:39.308374 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7ef3f695-50ef-409b-8091-f7ef56bbb567 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:39.325731 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ef3f695-50ef-409b-8091-f7ef56bbb567 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:39.326023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ef3f695-50ef-409b-8091-f7ef56bbb567 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:39.327869 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ef3f695-50ef-409b-8091-f7ef56bbb567 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:39.329127 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ef3f695-50ef-409b-8091-f7ef56bbb567 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:39.474312 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7ef3f695-50ef-409b-8091-f7ef56bbb567 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:39.489722 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7ef3f695-50ef-409b-8091-f7ef56bbb567 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1294 microversion: 2.1 time: 0.187839 Jun 22 18:38:39.503991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 55/114] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:39 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1294 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:39.621453 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-737f8034-7d38-4047-9c1b-a18e0d74d44e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:39.629943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-737f8034-7d38-4047-9c1b-a18e0d74d44e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.483513 Jun 22 18:38:39.634417 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 60/115] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:39 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:40.144575 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-41d484cd-14b2-4865-9043-867a84cd5bd8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:40.145213 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-41d484cd-14b2-4865-9043-867a84cd5bd8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:40.154271 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-41d484cd-14b2-4865-9043-867a84cd5bd8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:40.155255 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-41d484cd-14b2-4865-9043-867a84cd5bd8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:40.156382 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-41d484cd-14b2-4865-9043-867a84cd5bd8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:40.157142 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-41d484cd-14b2-4865-9043-867a84cd5bd8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:40.314667 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4165d6b2-d03b-488a-a12c-21c6bb579374 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:40.316165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4165d6b2-d03b-488a-a12c-21c6bb579374 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:40.333775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4165d6b2-d03b-488a-a12c-21c6bb579374 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:40.334501 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4165d6b2-d03b-488a-a12c-21c6bb579374 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:40.335455 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4165d6b2-d03b-488a-a12c-21c6bb579374 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:40.335934 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4165d6b2-d03b-488a-a12c-21c6bb579374 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:41.535593 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-41d484cd-14b2-4865-9043-867a84cd5bd8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:41.557888 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-41d484cd-14b2-4865-9043-867a84cd5bd8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:41.565810 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-41d484cd-14b2-4865-9043-867a84cd5bd8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:41.569454 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-41d484cd-14b2-4865-9043-867a84cd5bd8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 1.432235 Jun 22 18:38:41.578762 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 56/116] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:40 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:41.584792 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-87c8b277-eebc-4c63-9451-6e0a6dfc1642 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:41.585792 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-87c8b277-eebc-4c63-9451-6e0a6dfc1642 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:41.597062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-87c8b277-eebc-4c63-9451-6e0a6dfc1642 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:41.597798 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-87c8b277-eebc-4c63-9451-6e0a6dfc1642 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:41.598762 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-87c8b277-eebc-4c63-9451-6e0a6dfc1642 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:41.599393 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-87c8b277-eebc-4c63-9451-6e0a6dfc1642 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:41.705645 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4165d6b2-d03b-488a-a12c-21c6bb579374 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:41.713456 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4165d6b2-d03b-488a-a12c-21c6bb579374 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 1.403212 Jun 22 18:38:41.713916 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 61/117] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:40 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:41.736374 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5c99577e-fd22-45d8-b8d8-5c7cd7e2e2f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:41.737202 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5c99577e-fd22-45d8-b8d8-5c7cd7e2e2f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:41.747901 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5c99577e-fd22-45d8-b8d8-5c7cd7e2e2f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:41.749411 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5c99577e-fd22-45d8-b8d8-5c7cd7e2e2f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:41.750770 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5c99577e-fd22-45d8-b8d8-5c7cd7e2e2f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:41.751622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5c99577e-fd22-45d8-b8d8-5c7cd7e2e2f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:42.112468 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5c99577e-fd22-45d8-b8d8-5c7cd7e2e2f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:42.124960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5c99577e-fd22-45d8-b8d8-5c7cd7e2e2f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.393106 Jun 22 18:38:42.126107 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 62/118] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:41 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:42.255463 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-87c8b277-eebc-4c63-9451-6e0a6dfc1642 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:42.268996 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-87c8b277-eebc-4c63-9451-6e0a6dfc1642 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.688488 Jun 22 18:38:42.270134 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 57/119] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:41 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:42.379985 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-ecf38c72-d7cb-4265-a38d-db31153d05c5 req-845e5aa2-73c4-4477-b2a1-2ae3e5821c40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5414be47-8679-4c15-9b75-4da9d4d9ac1b", "tag": "398742f5-c1a9-424d-9b37-ae5ab7336f30"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:38:42.395453 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-ecf38c72-d7cb-4265-a38d-db31153d05c5 req-845e5aa2-73c4-4477-b2a1-2ae3e5821c40 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:42.396271 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-ecf38c72-d7cb-4265-a38d-db31153d05c5 req-845e5aa2-73c4-4477-b2a1-2ae3e5821c40 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:42.430480 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-98abcda3-597e-4b35-9759-e7d033926690 req-acbf7f91-4017-4f94-9565-50a75b2ea570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab156cb7-09be-4142-be86-0adbd49ae23f", "tag": "17ef6483-b512-4263-89ff-3669960db87f"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:38:42.442297 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-ecf38c72-d7cb-4265-a38d-db31153d05c5 req-845e5aa2-73c4-4477-b2a1-2ae3e5821c40 service nova] Creating event network-changed:398742f5-c1a9-424d-9b37-ae5ab7336f30 for instance 5414be47-8679-4c15-9b75-4da9d4d9ac1b on hv-cinder-81268 Jun 22 18:38:42.445622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-ecf38c72-d7cb-4265-a38d-db31153d05c5 req-845e5aa2-73c4-4477-b2a1-2ae3e5821c40 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129743) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 18:38:42.450161 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-76d71479-60bb-4fe6-850c-1c67c9613f4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:42.452400 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-76d71479-60bb-4fe6-850c-1c67c9613f4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:42.454891 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-76d71479-60bb-4fe6-850c-1c67c9613f4a None None] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:42.455717 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-76d71479-60bb-4fe6-850c-1c67c9613f4a None None] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:42.458917 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-98abcda3-597e-4b35-9759-e7d033926690 req-acbf7f91-4017-4f94-9565-50a75b2ea570 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:42.459725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-98abcda3-597e-4b35-9759-e7d033926690 req-acbf7f91-4017-4f94-9565-50a75b2ea570 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:42.522732 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.compute.rpcapi [None req-76d71479-60bb-4fe6-850c-1c67c9613f4a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 18:38:42.527411 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-76d71479-60bb-4fe6-850c-1c67c9613f4a None None] Releasing lock "compute-rpcapi-router" {{(pid=129743) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 18:38:42.556026 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-98abcda3-597e-4b35-9759-e7d033926690 req-acbf7f91-4017-4f94-9565-50a75b2ea570 service nova] Creating event network-changed:17ef6483-b512-4263-89ff-3669960db87f for instance ab156cb7-09be-4142-be86-0adbd49ae23f on hv-cinder-81268 Jun 22 18:38:42.556897 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-98abcda3-597e-4b35-9759-e7d033926690 req-acbf7f91-4017-4f94-9565-50a75b2ea570 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 18:38:42.558654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d3d37bb6-ed09-460e-8a53-875d4032b0e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:42.559375 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d3d37bb6-ed09-460e-8a53-875d4032b0e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:42.561126 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d3d37bb6-ed09-460e-8a53-875d4032b0e1 None None] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:42.561850 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d3d37bb6-ed09-460e-8a53-875d4032b0e1 None None] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:42.574334 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-76d71479-60bb-4fe6-850c-1c67c9613f4a None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299433 Jun 22 18:38:42.576120 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 58/120] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:38:42.586148 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.compute.rpcapi [None req-d3d37bb6-ed09-460e-8a53-875d4032b0e1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 18:38:42.589076 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d3d37bb6-ed09-460e-8a53-875d4032b0e1 None None] Releasing lock "compute-rpcapi-router" {{(pid=129744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 18:38:42.597287 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3bb58ec1-c7e4-4305-9fff-0104ddf3b9a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:42.598121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3bb58ec1-c7e4-4305-9fff-0104ddf3b9a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:42.621451 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3bb58ec1-c7e4-4305-9fff-0104ddf3b9a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:42.624578 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3bb58ec1-c7e4-4305-9fff-0104ddf3b9a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:42.628237 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3bb58ec1-c7e4-4305-9fff-0104ddf3b9a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:42.631619 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3bb58ec1-c7e4-4305-9fff-0104ddf3b9a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:42.640137 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d3d37bb6-ed09-460e-8a53-875d4032b0e1 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.511880 Jun 22 18:38:42.640986 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 63/121] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:38:42.732865 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-947c6958-3475-4b44-b600-7c0dd1d52f61 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:42.733668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-947c6958-3475-4b44-b600-7c0dd1d52f61 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:42.761808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-947c6958-3475-4b44-b600-7c0dd1d52f61 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:42.762403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-947c6958-3475-4b44-b600-7c0dd1d52f61 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:42.763678 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-947c6958-3475-4b44-b600-7c0dd1d52f61 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:42.764385 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-947c6958-3475-4b44-b600-7c0dd1d52f61 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:43.224572 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-947c6958-3475-4b44-b600-7c0dd1d52f61 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:43.237112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-947c6958-3475-4b44-b600-7c0dd1d52f61 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.510291 Jun 22 18:38:43.238120 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 64/122] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:42 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:43.243173 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5c8e2435-aad4-420d-a7e6-1a8da2dc95d4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:43.244154 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5c8e2435-aad4-420d-a7e6-1a8da2dc95d4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:43.252001 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5c8e2435-aad4-420d-a7e6-1a8da2dc95d4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:43.252452 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5c8e2435-aad4-420d-a7e6-1a8da2dc95d4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:43.253220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5c8e2435-aad4-420d-a7e6-1a8da2dc95d4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:43.253647 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5c8e2435-aad4-420d-a7e6-1a8da2dc95d4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:43.473804 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5c8e2435-aad4-420d-a7e6-1a8da2dc95d4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:43.484717 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5c8e2435-aad4-420d-a7e6-1a8da2dc95d4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.245282 Jun 22 18:38:43.486090 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 65/123] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:43 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:43.491465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-40e4525e-6027-40d9-9106-ed83e4d5716c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:43.492071 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-40e4525e-6027-40d9-9106-ed83e4d5716c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:43.499033 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-40e4525e-6027-40d9-9106-ed83e4d5716c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:43.499475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-40e4525e-6027-40d9-9106-ed83e4d5716c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:43.500266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-40e4525e-6027-40d9-9106-ed83e4d5716c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:43.500845 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-40e4525e-6027-40d9-9106-ed83e4d5716c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:43.537182 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3bb58ec1-c7e4-4305-9fff-0104ddf3b9a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:43.550941 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3bb58ec1-c7e4-4305-9fff-0104ddf3b9a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:43.552688 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3bb58ec1-c7e4-4305-9fff-0104ddf3b9a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:43.553971 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3bb58ec1-c7e4-4305-9fff-0104ddf3b9a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.961585 Jun 22 18:38:43.564860 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 59/124] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:42 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:43.797112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-40e4525e-6027-40d9-9106-ed83e4d5716c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:43.816729 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-40e4525e-6027-40d9-9106-ed83e4d5716c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.329246 Jun 22 18:38:43.818903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 66/125] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:43 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:44.255037 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-71115baa-73df-4c72-9d1f-50d586cea80c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:44.256308 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-71115baa-73df-4c72-9d1f-50d586cea80c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:44.268157 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71115baa-73df-4c72-9d1f-50d586cea80c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:44.269700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71115baa-73df-4c72-9d1f-50d586cea80c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:44.272491 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71115baa-73df-4c72-9d1f-50d586cea80c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:44.272927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71115baa-73df-4c72-9d1f-50d586cea80c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:44.475065 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-71115baa-73df-4c72-9d1f-50d586cea80c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:44.484633 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-71115baa-73df-4c72-9d1f-50d586cea80c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.233695 Jun 22 18:38:44.485941 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 60/126] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:44 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:44.506518 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-54647525-1b59-4309-96fe-ed83985218a9 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:44.507367 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-54647525-1b59-4309-96fe-ed83985218a9 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:44.515610 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-54647525-1b59-4309-96fe-ed83985218a9 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:44.516401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-54647525-1b59-4309-96fe-ed83985218a9 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:44.531024 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-54647525-1b59-4309-96fe-ed83985218a9 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:44.532305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-54647525-1b59-4309-96fe-ed83985218a9 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:44.577396 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-661aa804-203d-4b50-a006-b11192754150 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:44.579523 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-661aa804-203d-4b50-a006-b11192754150 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:44.589678 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-661aa804-203d-4b50-a006-b11192754150 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:44.590327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-661aa804-203d-4b50-a006-b11192754150 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:44.592668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=100 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:44.593796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-661aa804-203d-4b50-a006-b11192754150 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:44.597165 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-661aa804-203d-4b50-a006-b11192754150 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:44.608016 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:44.757703 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-661aa804-203d-4b50-a006-b11192754150 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:44.766107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-661aa804-203d-4b50-a006-b11192754150 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:44.768444 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-661aa804-203d-4b50-a006-b11192754150 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:44.771626 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-54647525-1b59-4309-96fe-ed83985218a9 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:44.779862 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-54647525-1b59-4309-96fe-ed83985218a9 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.278560 Jun 22 18:38:44.780625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 67/127] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:44 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:44.784943 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-661aa804-203d-4b50-a006-b11192754150 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.214897 Jun 22 18:38:44.786045 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 61/128] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:44 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:44.791470 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-27b8c291-e109-44a1-a187-3ec2dff06fa3 req-1b266c72-446c-44fe-b2cc-82624ba7291e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66481d9b-408f-4891-8b17-76fface18ff4", "tag": "1cdce800-1ea9-4867-93b1-faaebd9ff187"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:38:44.797172 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-183e8db3-fab1-47e4-9aa4-9cd0faf6bca7 req-f8c2077c-cb5c-4169-9dfb-81d56b339b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688c6da6-d454-4dc0-8335-b0a4e16f5824", "tag": "24070ee1-9191-4d52-8234-91ae16aa72a0"}, {"name": "network-changed", "server_uuid": "2a9799ba-7e8d-4145-b942-752d45813cfc", "tag": "ff5e1751-3636-44a9-8f6a-879586f4b3a2"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:38:44.800620 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-27b8c291-e109-44a1-a187-3ec2dff06fa3 req-1b266c72-446c-44fe-b2cc-82624ba7291e service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:44.801064 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-27b8c291-e109-44a1-a187-3ec2dff06fa3 req-1b266c72-446c-44fe-b2cc-82624ba7291e service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:44.806385 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-183e8db3-fab1-47e4-9aa4-9cd0faf6bca7 req-f8c2077c-cb5c-4169-9dfb-81d56b339b2b service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:44.807412 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-183e8db3-fab1-47e4-9aa4-9cd0faf6bca7 req-f8c2077c-cb5c-4169-9dfb-81d56b339b2b service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:44.814545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-27b8c291-e109-44a1-a187-3ec2dff06fa3 req-1b266c72-446c-44fe-b2cc-82624ba7291e service nova] Creating event network-changed:1cdce800-1ea9-4867-93b1-faaebd9ff187 for instance 66481d9b-408f-4891-8b17-76fface18ff4 on hv-cinder-81268 Jun 22 18:38:44.820797 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-27b8c291-e109-44a1-a187-3ec2dff06fa3 req-1b266c72-446c-44fe-b2cc-82624ba7291e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033339 Jun 22 18:38:44.821803 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 62/129] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:38:44.823331 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-183e8db3-fab1-47e4-9aa4-9cd0faf6bca7 req-f8c2077c-cb5c-4169-9dfb-81d56b339b2b service nova] Creating event network-changed:24070ee1-9191-4d52-8234-91ae16aa72a0 for instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 on hv-cinder-81268 Jun 22 18:38:44.823850 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-183e8db3-fab1-47e4-9aa4-9cd0faf6bca7 req-f8c2077c-cb5c-4169-9dfb-81d56b339b2b service nova] Creating event network-changed:ff5e1751-3636-44a9-8f6a-879586f4b3a2 for instance 2a9799ba-7e8d-4145-b942-752d45813cfc on hv-cinder-81268 Jun 22 18:38:44.836197 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3787c422-4aaa-4631-8658-62df5d00eb07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:44.836891 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3787c422-4aaa-4631-8658-62df5d00eb07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:44.839622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-183e8db3-fab1-47e4-9aa4-9cd0faf6bca7 req-f8c2077c-cb5c-4169-9dfb-81d56b339b2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057997 Jun 22 18:38:44.840549 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 68/130] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:38:44.844451 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3787c422-4aaa-4631-8658-62df5d00eb07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:44.844896 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3787c422-4aaa-4631-8658-62df5d00eb07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:44.845683 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3787c422-4aaa-4631-8658-62df5d00eb07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:44.846099 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3787c422-4aaa-4631-8658-62df5d00eb07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:45.017920 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3787c422-4aaa-4631-8658-62df5d00eb07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:45.035469 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3787c422-4aaa-4631-8658-62df5d00eb07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.203889 Jun 22 18:38:45.046733 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 63/131] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:44 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:45.502976 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-16f28330-ae27-4fbb-8840-8686728c3819 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:45.503687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-16f28330-ae27-4fbb-8840-8686728c3819 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:45.510006 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-16f28330-ae27-4fbb-8840-8686728c3819 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:45.510448 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-16f28330-ae27-4fbb-8840-8686728c3819 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:45.511202 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-16f28330-ae27-4fbb-8840-8686728c3819 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:45.511625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-16f28330-ae27-4fbb-8840-8686728c3819 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:45.659272 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-16f28330-ae27-4fbb-8840-8686728c3819 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:45.660379 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-16f28330-ae27-4fbb-8840-8686728c3819 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.161515 Jun 22 18:38:45.660948 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 69/132] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:45 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:45.797355 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ca9d05a3-b84a-413b-ad68-57c11f061569 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:45.798001 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ca9d05a3-b84a-413b-ad68-57c11f061569 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:45.802375 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-518a51c5-ec8b-45a6-96cb-7d1f7d64dccd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:45.803616 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-518a51c5-ec8b-45a6-96cb-7d1f7d64dccd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:45.805929 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca9d05a3-b84a-413b-ad68-57c11f061569 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:45.806721 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca9d05a3-b84a-413b-ad68-57c11f061569 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:45.807740 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca9d05a3-b84a-413b-ad68-57c11f061569 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:45.808211 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca9d05a3-b84a-413b-ad68-57c11f061569 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:45.811044 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-518a51c5-ec8b-45a6-96cb-7d1f7d64dccd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:45.811481 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-518a51c5-ec8b-45a6-96cb-7d1f7d64dccd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:45.812274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-518a51c5-ec8b-45a6-96cb-7d1f7d64dccd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:45.812907 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-518a51c5-ec8b-45a6-96cb-7d1f7d64dccd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:45.958676 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-518a51c5-ec8b-45a6-96cb-7d1f7d64dccd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:45.972982 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-518a51c5-ec8b-45a6-96cb-7d1f7d64dccd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:45.980218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-518a51c5-ec8b-45a6-96cb-7d1f7d64dccd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:45.984455 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-518a51c5-ec8b-45a6-96cb-7d1f7d64dccd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.185782 Jun 22 18:38:45.986427 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 70/133] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:45 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:46.011809 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ca9d05a3-b84a-413b-ad68-57c11f061569 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:46.027788 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ca9d05a3-b84a-413b-ad68-57c11f061569 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.234409 Jun 22 18:38:46.028999 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 64/134] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:45 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:46.054398 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-664d2f7c-8c2f-4db6-b640-ca80c7709c96 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:46.055002 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-664d2f7c-8c2f-4db6-b640-ca80c7709c96 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:46.062832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-664d2f7c-8c2f-4db6-b640-ca80c7709c96 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:46.063319 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-664d2f7c-8c2f-4db6-b640-ca80c7709c96 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:46.064223 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-664d2f7c-8c2f-4db6-b640-ca80c7709c96 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:46.064672 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-664d2f7c-8c2f-4db6-b640-ca80c7709c96 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:46.322318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-664d2f7c-8c2f-4db6-b640-ca80c7709c96 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:46.330191 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-664d2f7c-8c2f-4db6-b640-ca80c7709c96 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.279524 Jun 22 18:38:46.330746 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 71/135] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:46 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:46.678671 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-787230c7-4ab0-47ea-aace-f79b7e4f9bdb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:46.680097 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-787230c7-4ab0-47ea-aace-f79b7e4f9bdb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:46.688785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-787230c7-4ab0-47ea-aace-f79b7e4f9bdb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:46.689857 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-787230c7-4ab0-47ea-aace-f79b7e4f9bdb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:46.690600 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-787230c7-4ab0-47ea-aace-f79b7e4f9bdb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:46.691034 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-787230c7-4ab0-47ea-aace-f79b7e4f9bdb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:46.839199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-787230c7-4ab0-47ea-aace-f79b7e4f9bdb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:46.846917 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-787230c7-4ab0-47ea-aace-f79b7e4f9bdb tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.173253 Jun 22 18:38:46.847485 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 65/136] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:46 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:47.004734 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-651969d5-18b1-43ce-9cc8-1d5916bbb511 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:47.005324 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-651969d5-18b1-43ce-9cc8-1d5916bbb511 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:47.011799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-651969d5-18b1-43ce-9cc8-1d5916bbb511 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:47.012272 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-651969d5-18b1-43ce-9cc8-1d5916bbb511 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:47.013870 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-651969d5-18b1-43ce-9cc8-1d5916bbb511 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:47.014297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-651969d5-18b1-43ce-9cc8-1d5916bbb511 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:47.046147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-beae4775-c532-4dc6-a7db-8673a757dd56 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:47.046785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-beae4775-c532-4dc6-a7db-8673a757dd56 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:47.052891 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-beae4775-c532-4dc6-a7db-8673a757dd56 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:47.053340 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-beae4775-c532-4dc6-a7db-8673a757dd56 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:47.054106 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-beae4775-c532-4dc6-a7db-8673a757dd56 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:47.054540 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-beae4775-c532-4dc6-a7db-8673a757dd56 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:47.145668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-651969d5-18b1-43ce-9cc8-1d5916bbb511 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:47.154749 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-651969d5-18b1-43ce-9cc8-1d5916bbb511 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:47.156787 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-651969d5-18b1-43ce-9cc8-1d5916bbb511 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:47.157986 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-651969d5-18b1-43ce-9cc8-1d5916bbb511 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.157593 Jun 22 18:38:47.158799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 72/137] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:46 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:47.186648 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-beae4775-c532-4dc6-a7db-8673a757dd56 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:47.194680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-beae4775-c532-4dc6-a7db-8673a757dd56 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.153003 Jun 22 18:38:47.195565 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 66/138] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:47 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:47.347281 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b5c5d6a0-1a0c-4ef8-9c2f-fa4d3c1271dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:47.347792 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b5c5d6a0-1a0c-4ef8-9c2f-fa4d3c1271dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:47.353919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b5c5d6a0-1a0c-4ef8-9c2f-fa4d3c1271dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:47.354365 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b5c5d6a0-1a0c-4ef8-9c2f-fa4d3c1271dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:47.355130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b5c5d6a0-1a0c-4ef8-9c2f-fa4d3c1271dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:47.355562 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b5c5d6a0-1a0c-4ef8-9c2f-fa4d3c1271dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:47.494041 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b5c5d6a0-1a0c-4ef8-9c2f-fa4d3c1271dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:47.502584 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b5c5d6a0-1a0c-4ef8-9c2f-fa4d3c1271dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.159318 Jun 22 18:38:47.503166 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 73/139] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:47 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:47.863780 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6629d819-4814-4c14-bbd1-19dfb63bb533 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:47.864500 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6629d819-4814-4c14-bbd1-19dfb63bb533 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:47.870838 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6629d819-4814-4c14-bbd1-19dfb63bb533 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:47.871289 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6629d819-4814-4c14-bbd1-19dfb63bb533 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:47.872743 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6629d819-4814-4c14-bbd1-19dfb63bb533 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:47.873787 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6629d819-4814-4c14-bbd1-19dfb63bb533 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:48.033984 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6629d819-4814-4c14-bbd1-19dfb63bb533 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:48.041566 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6629d819-4814-4c14-bbd1-19dfb63bb533 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.181737 Jun 22 18:38:48.042239 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 67/140] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:47 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:48.176624 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9f30272a-ee8f-4d44-8258-ffefcd2543b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:48.177238 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9f30272a-ee8f-4d44-8258-ffefcd2543b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:48.183138 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9f30272a-ee8f-4d44-8258-ffefcd2543b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:48.183577 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9f30272a-ee8f-4d44-8258-ffefcd2543b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:48.184388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9f30272a-ee8f-4d44-8258-ffefcd2543b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:48.185478 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9f30272a-ee8f-4d44-8258-ffefcd2543b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:48.210426 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ecfc014c-2467-4260-9ffe-bd1e41400d19 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:48.211023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ecfc014c-2467-4260-9ffe-bd1e41400d19 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:48.218232 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ecfc014c-2467-4260-9ffe-bd1e41400d19 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:48.218669 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ecfc014c-2467-4260-9ffe-bd1e41400d19 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:48.219419 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ecfc014c-2467-4260-9ffe-bd1e41400d19 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:48.219860 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ecfc014c-2467-4260-9ffe-bd1e41400d19 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:48.313800 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9f30272a-ee8f-4d44-8258-ffefcd2543b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:48.321840 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9f30272a-ee8f-4d44-8258-ffefcd2543b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:48.323403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9f30272a-ee8f-4d44-8258-ffefcd2543b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:48.324526 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9f30272a-ee8f-4d44-8258-ffefcd2543b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.151940 Jun 22 18:38:48.325076 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 74/141] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:48 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:48.352247 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ecfc014c-2467-4260-9ffe-bd1e41400d19 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:48.359865 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ecfc014c-2467-4260-9ffe-bd1e41400d19 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.153161 Jun 22 18:38:48.360431 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 68/142] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:48 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:48.520324 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a5bb820e-1538-4185-9aee-b58aa8bc9912 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:48.521106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a5bb820e-1538-4185-9aee-b58aa8bc9912 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:48.527973 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a5bb820e-1538-4185-9aee-b58aa8bc9912 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:48.528500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a5bb820e-1538-4185-9aee-b58aa8bc9912 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:48.529283 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a5bb820e-1538-4185-9aee-b58aa8bc9912 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:48.529761 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a5bb820e-1538-4185-9aee-b58aa8bc9912 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:48.666511 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a5bb820e-1538-4185-9aee-b58aa8bc9912 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:48.674406 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a5bb820e-1538-4185-9aee-b58aa8bc9912 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.157988 Jun 22 18:38:48.674965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 75/143] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:48 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:49.060019 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-8cfea232-7653-4024-9f5b-4d9ca5cd22ec tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:49.060748 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-8cfea232-7653-4024-9f5b-4d9ca5cd22ec tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:49.071555 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8cfea232-7653-4024-9f5b-4d9ca5cd22ec tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:49.077495 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8cfea232-7653-4024-9f5b-4d9ca5cd22ec tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:49.079048 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8cfea232-7653-4024-9f5b-4d9ca5cd22ec tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:49.079048 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8cfea232-7653-4024-9f5b-4d9ca5cd22ec tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:49.350755 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-eb05211b-5d86-445c-a695-3858d4f50ac1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:49.351409 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-eb05211b-5d86-445c-a695-3858d4f50ac1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:49.357865 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-8cfea232-7653-4024-9f5b-4d9ca5cd22ec tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:49.359633 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eb05211b-5d86-445c-a695-3858d4f50ac1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:49.360061 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eb05211b-5d86-445c-a695-3858d4f50ac1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:49.360988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eb05211b-5d86-445c-a695-3858d4f50ac1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:49.361559 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eb05211b-5d86-445c-a695-3858d4f50ac1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:49.370742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-8cfea232-7653-4024-9f5b-4d9ca5cd22ec tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.315391 Jun 22 18:38:49.380365 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 69/144] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:49 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:49.386490 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7b10e4de-ec31-4a97-a6d7-3f17a421338e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:49.388955 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7b10e4de-ec31-4a97-a6d7-3f17a421338e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:49.397814 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7b10e4de-ec31-4a97-a6d7-3f17a421338e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:49.398477 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7b10e4de-ec31-4a97-a6d7-3f17a421338e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:49.399601 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7b10e4de-ec31-4a97-a6d7-3f17a421338e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:49.400677 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7b10e4de-ec31-4a97-a6d7-3f17a421338e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:49.557220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7b10e4de-ec31-4a97-a6d7-3f17a421338e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:49.567559 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7b10e4de-ec31-4a97-a6d7-3f17a421338e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.185793 Jun 22 18:38:49.568175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 70/145] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:49 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:49.581989 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-eb05211b-5d86-445c-a695-3858d4f50ac1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:49.589891 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-eb05211b-5d86-445c-a695-3858d4f50ac1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:49.591456 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-eb05211b-5d86-445c-a695-3858d4f50ac1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:49.592859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-eb05211b-5d86-445c-a695-3858d4f50ac1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.254340 Jun 22 18:38:49.593655 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 76/146] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:49 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:49.692799 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-dcc1dce4-bd15-44cf-b00a-43a10af61b68 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:49.693967 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-dcc1dce4-bd15-44cf-b00a-43a10af61b68 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:49.701502 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dcc1dce4-bd15-44cf-b00a-43a10af61b68 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:49.701958 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dcc1dce4-bd15-44cf-b00a-43a10af61b68 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:49.702729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dcc1dce4-bd15-44cf-b00a-43a10af61b68 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:49.703156 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dcc1dce4-bd15-44cf-b00a-43a10af61b68 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:49.862797 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-dcc1dce4-bd15-44cf-b00a-43a10af61b68 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:49.875667 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-dcc1dce4-bd15-44cf-b00a-43a10af61b68 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.187957 Jun 22 18:38:49.876283 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 71/147] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:49 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:50.388954 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a1427e40-58b9-4cff-a3e6-e44b58b14967 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:50.389557 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a1427e40-58b9-4cff-a3e6-e44b58b14967 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:50.398110 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a1427e40-58b9-4cff-a3e6-e44b58b14967 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:50.398556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a1427e40-58b9-4cff-a3e6-e44b58b14967 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:50.399311 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a1427e40-58b9-4cff-a3e6-e44b58b14967 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:50.399737 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a1427e40-58b9-4cff-a3e6-e44b58b14967 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:50.539237 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a1427e40-58b9-4cff-a3e6-e44b58b14967 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:50.548855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a1427e40-58b9-4cff-a3e6-e44b58b14967 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.164457 Jun 22 18:38:50.558115 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 77/148] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:50 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:50.584804 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-75a49c49-2288-487a-b4e0-789a8bb41d46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:50.585784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-75a49c49-2288-487a-b4e0-789a8bb41d46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:50.592107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75a49c49-2288-487a-b4e0-789a8bb41d46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:50.592555 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75a49c49-2288-487a-b4e0-789a8bb41d46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:50.593369 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75a49c49-2288-487a-b4e0-789a8bb41d46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:50.593804 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75a49c49-2288-487a-b4e0-789a8bb41d46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:50.612763 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b6c2a44a-6600-4d88-b705-a86bb8431062 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:50.613566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b6c2a44a-6600-4d88-b705-a86bb8431062 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:50.620716 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b6c2a44a-6600-4d88-b705-a86bb8431062 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:50.621458 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b6c2a44a-6600-4d88-b705-a86bb8431062 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:50.622944 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b6c2a44a-6600-4d88-b705-a86bb8431062 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:50.623480 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b6c2a44a-6600-4d88-b705-a86bb8431062 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:50.736983 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-75a49c49-2288-487a-b4e0-789a8bb41d46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:50.745264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-75a49c49-2288-487a-b4e0-789a8bb41d46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.164347 Jun 22 18:38:50.745995 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 72/149] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:50 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:50.761563 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b6c2a44a-6600-4d88-b705-a86bb8431062 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:50.769988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b6c2a44a-6600-4d88-b705-a86bb8431062 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:50.771998 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b6c2a44a-6600-4d88-b705-a86bb8431062 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:50.773236 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b6c2a44a-6600-4d88-b705-a86bb8431062 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.164879 Jun 22 18:38:50.773858 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 78/150] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:50 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:50.893640 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d47a2380-1709-416a-9b63-4cadab2d470f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:50.894156 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d47a2380-1709-416a-9b63-4cadab2d470f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:50.900798 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d47a2380-1709-416a-9b63-4cadab2d470f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:50.901468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d47a2380-1709-416a-9b63-4cadab2d470f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:50.902000 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d47a2380-1709-416a-9b63-4cadab2d470f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:50.902430 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d47a2380-1709-416a-9b63-4cadab2d470f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:51.041058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d47a2380-1709-416a-9b63-4cadab2d470f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:51.049403 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d47a2380-1709-416a-9b63-4cadab2d470f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.159963 Jun 22 18:38:51.050045 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 73/151] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:50 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:51.565940 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2fe09ef4-a510-4d7b-ad05-7342fb212254 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:51.566540 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2fe09ef4-a510-4d7b-ad05-7342fb212254 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:51.572777 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2fe09ef4-a510-4d7b-ad05-7342fb212254 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:51.573280 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2fe09ef4-a510-4d7b-ad05-7342fb212254 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:51.574038 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2fe09ef4-a510-4d7b-ad05-7342fb212254 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:51.574464 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2fe09ef4-a510-4d7b-ad05-7342fb212254 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:51.705897 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-2fe09ef4-a510-4d7b-ad05-7342fb212254 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:51.713275 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2fe09ef4-a510-4d7b-ad05-7342fb212254 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.151246 Jun 22 18:38:51.713830 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 79/152] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:51 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:51.762590 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5784956d-bc53-407f-ab4b-9e7e2140459e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:51.763349 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5784956d-bc53-407f-ab4b-9e7e2140459e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:51.766458 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:51.770314 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5784956d-bc53-407f-ab4b-9e7e2140459e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:51.770751 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5784956d-bc53-407f-ab4b-9e7e2140459e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:51.771501 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5784956d-bc53-407f-ab4b-9e7e2140459e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:51.771951 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5784956d-bc53-407f-ab4b-9e7e2140459e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:51.791787 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0683fe53-3c7e-4fca-a39e-904dc8a3adad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:51.792541 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0683fe53-3c7e-4fca-a39e-904dc8a3adad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:51.799256 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0683fe53-3c7e-4fca-a39e-904dc8a3adad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:51.799782 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0683fe53-3c7e-4fca-a39e-904dc8a3adad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:51.800578 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0683fe53-3c7e-4fca-a39e-904dc8a3adad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:51.801019 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0683fe53-3c7e-4fca-a39e-904dc8a3adad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:51.902594 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5784956d-bc53-407f-ab4b-9e7e2140459e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:51.910100 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5784956d-bc53-407f-ab4b-9e7e2140459e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.151331 Jun 22 18:38:51.910672 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 74/153] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:51 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:51.929524 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0683fe53-3c7e-4fca-a39e-904dc8a3adad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:51.938534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0683fe53-3c7e-4fca-a39e-904dc8a3adad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:51.940067 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0683fe53-3c7e-4fca-a39e-904dc8a3adad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:51.941155 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0683fe53-3c7e-4fca-a39e-904dc8a3adad tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.153339 Jun 22 18:38:51.941718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 80/154] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:51 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:52.066517 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-124e989d-b2fa-403c-a60f-f1d76614a2ae tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:52.067367 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-124e989d-b2fa-403c-a60f-f1d76614a2ae tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:52.074466 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-124e989d-b2fa-403c-a60f-f1d76614a2ae tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:52.075342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-124e989d-b2fa-403c-a60f-f1d76614a2ae tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:52.076618 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-124e989d-b2fa-403c-a60f-f1d76614a2ae tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:52.077457 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-124e989d-b2fa-403c-a60f-f1d76614a2ae tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:52.212553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-124e989d-b2fa-403c-a60f-f1d76614a2ae tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:52.220264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-124e989d-b2fa-403c-a60f-f1d76614a2ae tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.157757 Jun 22 18:38:52.220827 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 75/155] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:52 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:52.729943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7a62f848-9392-4e21-949a-dc7009e2403b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:52.730680 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7a62f848-9392-4e21-949a-dc7009e2403b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:52.733370 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:52.739112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7a62f848-9392-4e21-949a-dc7009e2403b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:52.739551 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7a62f848-9392-4e21-949a-dc7009e2403b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:52.740362 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7a62f848-9392-4e21-949a-dc7009e2403b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:52.740785 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7a62f848-9392-4e21-949a-dc7009e2403b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:52.873133 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7a62f848-9392-4e21-949a-dc7009e2403b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:52.883122 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7a62f848-9392-4e21-949a-dc7009e2403b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.156754 Jun 22 18:38:52.883688 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 81/156] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:52 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:52.927798 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d903cbbd-3860-4869-ab29-30b21f5bb937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:52.928422 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d903cbbd-3860-4869-ab29-30b21f5bb937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:52.930287 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:52.935941 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d903cbbd-3860-4869-ab29-30b21f5bb937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:52.936387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d903cbbd-3860-4869-ab29-30b21f5bb937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:52.937143 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d903cbbd-3860-4869-ab29-30b21f5bb937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:52.937574 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d903cbbd-3860-4869-ab29-30b21f5bb937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:52.958316 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-71e12fe5-fcad-4ab6-9ac7-46af5ccec5cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:52.958916 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-71e12fe5-fcad-4ab6-9ac7-46af5ccec5cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:52.964921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-71e12fe5-fcad-4ab6-9ac7-46af5ccec5cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:52.965365 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-71e12fe5-fcad-4ab6-9ac7-46af5ccec5cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:52.966627 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-71e12fe5-fcad-4ab6-9ac7-46af5ccec5cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:52.967063 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-71e12fe5-fcad-4ab6-9ac7-46af5ccec5cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:53.068872 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d903cbbd-3860-4869-ab29-30b21f5bb937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:53.077270 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d903cbbd-3860-4869-ab29-30b21f5bb937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.153278 Jun 22 18:38:53.077841 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 76/157] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:52 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:53.111687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-71e12fe5-fcad-4ab6-9ac7-46af5ccec5cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:53.119790 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-71e12fe5-fcad-4ab6-9ac7-46af5ccec5cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:53.121339 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-71e12fe5-fcad-4ab6-9ac7-46af5ccec5cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:53.122483 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-71e12fe5-fcad-4ab6-9ac7-46af5ccec5cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.168032 Jun 22 18:38:53.123043 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 82/158] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:52 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:53.236491 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4f2bca27-d13e-4156-8a04-dd9a290911dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:53.237095 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-4f2bca27-d13e-4156-8a04-dd9a290911dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:53.243145 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4f2bca27-d13e-4156-8a04-dd9a290911dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:53.243582 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4f2bca27-d13e-4156-8a04-dd9a290911dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:53.244362 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4f2bca27-d13e-4156-8a04-dd9a290911dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:53.244787 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4f2bca27-d13e-4156-8a04-dd9a290911dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:53.383714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4f2bca27-d13e-4156-8a04-dd9a290911dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:53.394714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4f2bca27-d13e-4156-8a04-dd9a290911dd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.162034 Jun 22 18:38:53.396159 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 77/159] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:53 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:53.899707 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1d5acfeb-4daf-4daf-89b4-67b3d2b7de41 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:53.900235 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-1d5acfeb-4daf-4daf-89b4-67b3d2b7de41 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:53.906666 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1d5acfeb-4daf-4daf-89b4-67b3d2b7de41 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:53.907101 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1d5acfeb-4daf-4daf-89b4-67b3d2b7de41 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:53.907859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1d5acfeb-4daf-4daf-89b4-67b3d2b7de41 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:53.908368 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1d5acfeb-4daf-4daf-89b4-67b3d2b7de41 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:54.037583 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-1d5acfeb-4daf-4daf-89b4-67b3d2b7de41 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:54.046531 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-1d5acfeb-4daf-4daf-89b4-67b3d2b7de41 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.150554 Jun 22 18:38:54.047277 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 83/160] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:53 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:54.094475 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-22719425-795d-4d6c-a1d0-737e9e42d941 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:54.095102 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-22719425-795d-4d6c-a1d0-737e9e42d941 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:54.101494 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-22719425-795d-4d6c-a1d0-737e9e42d941 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:54.101932 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-22719425-795d-4d6c-a1d0-737e9e42d941 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:54.102685 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-22719425-795d-4d6c-a1d0-737e9e42d941 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:54.103111 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-22719425-795d-4d6c-a1d0-737e9e42d941 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:54.124376 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:54.140167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cb16bf0b-7184-4377-9d20-392a55fae528 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:54.140765 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cb16bf0b-7184-4377-9d20-392a55fae528 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:54.147222 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cb16bf0b-7184-4377-9d20-392a55fae528 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:54.147658 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cb16bf0b-7184-4377-9d20-392a55fae528 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:54.148649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cb16bf0b-7184-4377-9d20-392a55fae528 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:54.149228 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cb16bf0b-7184-4377-9d20-392a55fae528 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:54.249159 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-22719425-795d-4d6c-a1d0-737e9e42d941 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:54.256870 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-22719425-795d-4d6c-a1d0-737e9e42d941 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.167035 Jun 22 18:38:54.257439 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 78/161] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:54 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:54.298437 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cb16bf0b-7184-4377-9d20-392a55fae528 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:54.301965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=100 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:54.307617 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cb16bf0b-7184-4377-9d20-392a55fae528 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:54.309351 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cb16bf0b-7184-4377-9d20-392a55fae528 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:54.310589 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cb16bf0b-7184-4377-9d20-392a55fae528 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.174431 Jun 22 18:38:54.311174 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 84/162] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:54 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:54.415238 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f6b18e4c-069d-4a93-b98b-0439ae031cc9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:54.415938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f6b18e4c-069d-4a93-b98b-0439ae031cc9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:54.423919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f6b18e4c-069d-4a93-b98b-0439ae031cc9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:54.424480 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f6b18e4c-069d-4a93-b98b-0439ae031cc9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:54.425995 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f6b18e4c-069d-4a93-b98b-0439ae031cc9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:54.426487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f6b18e4c-069d-4a93-b98b-0439ae031cc9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:54.566543 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f6b18e4c-069d-4a93-b98b-0439ae031cc9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:54.573964 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f6b18e4c-069d-4a93-b98b-0439ae031cc9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.165071 Jun 22 18:38:54.574517 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 79/163] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:54 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:55.066457 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-746013f6-4c6f-41ff-abf4-d473e45c01b7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:55.067059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-746013f6-4c6f-41ff-abf4-d473e45c01b7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:55.073364 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-746013f6-4c6f-41ff-abf4-d473e45c01b7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:55.073807 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-746013f6-4c6f-41ff-abf4-d473e45c01b7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:55.074860 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-746013f6-4c6f-41ff-abf4-d473e45c01b7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:55.076600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-746013f6-4c6f-41ff-abf4-d473e45c01b7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:55.217948 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-746013f6-4c6f-41ff-abf4-d473e45c01b7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:55.225593 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-746013f6-4c6f-41ff-abf4-d473e45c01b7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.163680 Jun 22 18:38:55.226155 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 85/164] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:55 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:55.274170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3df25d5d-e23f-4322-903f-56852f82471f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:55.275013 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3df25d5d-e23f-4322-903f-56852f82471f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:55.281090 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3df25d5d-e23f-4322-903f-56852f82471f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:55.281745 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3df25d5d-e23f-4322-903f-56852f82471f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:55.282672 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3df25d5d-e23f-4322-903f-56852f82471f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:55.283261 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3df25d5d-e23f-4322-903f-56852f82471f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:55.330307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f0f7921c-39b9-431c-9e11-c41c48a6d276 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:55.330938 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f0f7921c-39b9-431c-9e11-c41c48a6d276 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:55.338312 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f0f7921c-39b9-431c-9e11-c41c48a6d276 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:55.338772 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f0f7921c-39b9-431c-9e11-c41c48a6d276 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:55.339548 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f0f7921c-39b9-431c-9e11-c41c48a6d276 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:55.340183 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f0f7921c-39b9-431c-9e11-c41c48a6d276 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:55.442203 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3df25d5d-e23f-4322-903f-56852f82471f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:55.450129 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3df25d5d-e23f-4322-903f-56852f82471f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.179704 Jun 22 18:38:55.459183 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 80/165] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:55 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:55.524514 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f0f7921c-39b9-431c-9e11-c41c48a6d276 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:55.536469 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f0f7921c-39b9-431c-9e11-c41c48a6d276 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:55.538509 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f0f7921c-39b9-431c-9e11-c41c48a6d276 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:55.539620 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f0f7921c-39b9-431c-9e11-c41c48a6d276 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.214911 Jun 22 18:38:55.540200 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 86/166] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:55 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:55.590348 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1f5296d9-a712-4bdc-a96c-bb0229400134 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:55.592299 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1f5296d9-a712-4bdc-a96c-bb0229400134 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:55.599092 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f5296d9-a712-4bdc-a96c-bb0229400134 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:55.599253 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f5296d9-a712-4bdc-a96c-bb0229400134 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:55.600817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f5296d9-a712-4bdc-a96c-bb0229400134 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:55.601403 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f5296d9-a712-4bdc-a96c-bb0229400134 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:55.764206 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1f5296d9-a712-4bdc-a96c-bb0229400134 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:55.777885 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1f5296d9-a712-4bdc-a96c-bb0229400134 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.191249 Jun 22 18:38:55.779685 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 81/167] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:55 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:56.244099 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-08a774c4-6f18-448a-912a-0ec257e2ba52 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:56.245073 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-08a774c4-6f18-448a-912a-0ec257e2ba52 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:56.254301 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-08a774c4-6f18-448a-912a-0ec257e2ba52 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:56.254807 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-08a774c4-6f18-448a-912a-0ec257e2ba52 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:56.256549 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-08a774c4-6f18-448a-912a-0ec257e2ba52 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:56.258384 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-08a774c4-6f18-448a-912a-0ec257e2ba52 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:56.470330 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-27da3d81-5b85-4601-86e8-31d3bbb85927 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:56.471019 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-27da3d81-5b85-4601-86e8-31d3bbb85927 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:56.490672 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-27da3d81-5b85-4601-86e8-31d3bbb85927 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:56.491117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-27da3d81-5b85-4601-86e8-31d3bbb85927 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:56.495167 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-27da3d81-5b85-4601-86e8-31d3bbb85927 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:56.498364 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-27da3d81-5b85-4601-86e8-31d3bbb85927 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:56.713112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-08a774c4-6f18-448a-912a-0ec257e2ba52 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:56.727799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-08a774c4-6f18-448a-912a-0ec257e2ba52 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.487922 Jun 22 18:38:56.728814 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 87/168] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:56 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:56.860443 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-27da3d81-5b85-4601-86e8-31d3bbb85927 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:56.875318 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-27da3d81-5b85-4601-86e8-31d3bbb85927 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.412252 Jun 22 18:38:56.888403 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 82/169] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:56 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:56.899423 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2e16faea-b1f7-4504-8986-4cde01a075f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:56.901712 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2e16faea-b1f7-4504-8986-4cde01a075f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:56.920844 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2e16faea-b1f7-4504-8986-4cde01a075f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:56.923640 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2e16faea-b1f7-4504-8986-4cde01a075f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:56.924687 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2e16faea-b1f7-4504-8986-4cde01a075f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:56.926212 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2e16faea-b1f7-4504-8986-4cde01a075f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:57.027749 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-5a15f4b2-0701-44b2-8838-428f4abe99f4 req-1766f570-90f2-43ce-8880-8463d8f517b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66481d9b-408f-4891-8b17-76fface18ff4", "name": "network-vif-plugged", "status": "completed", "tag": "1cdce800-1ea9-4867-93b1-faaebd9ff187"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:38:57.036578 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=99 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:38:57.039797 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-5a15f4b2-0701-44b2-8838-428f4abe99f4 req-1766f570-90f2-43ce-8880-8463d8f517b3 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:57.040263 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-5a15f4b2-0701-44b2-8838-428f4abe99f4 req-1766f570-90f2-43ce-8880-8463d8f517b3 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:57.053885 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-5a15f4b2-0701-44b2-8838-428f4abe99f4 req-1766f570-90f2-43ce-8880-8463d8f517b3 service nova] Creating event network-vif-plugged:1cdce800-1ea9-4867-93b1-faaebd9ff187 for instance 66481d9b-408f-4891-8b17-76fface18ff4 on hv-cinder-81268 Jun 22 18:38:57.063138 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-5a15f4b2-0701-44b2-8838-428f4abe99f4 req-1766f570-90f2-43ce-8880-8463d8f517b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.326505 Jun 22 18:38:57.070163 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 88/170] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:38:57.082877 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-498375ed-5435-4d3d-9808-4b4d56c1b199 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:57.084996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-498375ed-5435-4d3d-9808-4b4d56c1b199 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:57.097493 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-498375ed-5435-4d3d-9808-4b4d56c1b199 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:57.097948 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-498375ed-5435-4d3d-9808-4b4d56c1b199 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:57.098718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-498375ed-5435-4d3d-9808-4b4d56c1b199 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:57.099152 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-498375ed-5435-4d3d-9808-4b4d56c1b199 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:57.539125 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-498375ed-5435-4d3d-9808-4b4d56c1b199 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:57.558120 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-498375ed-5435-4d3d-9808-4b4d56c1b199 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.486654 Jun 22 18:38:57.564819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 89/171] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:57 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:57.717886 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2e16faea-b1f7-4504-8986-4cde01a075f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:57.726559 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2e16faea-b1f7-4504-8986-4cde01a075f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:57.728133 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2e16faea-b1f7-4504-8986-4cde01a075f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:57.729279 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2e16faea-b1f7-4504-8986-4cde01a075f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.839744 Jun 22 18:38:57.729864 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 83/172] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:56 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:38:57.746248 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6c3a35cd-dde7-41cc-915e-73f0af7d4aff tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:57.747237 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6c3a35cd-dde7-41cc-915e-73f0af7d4aff tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:57.756117 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6c3a35cd-dde7-41cc-915e-73f0af7d4aff tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:57.756901 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6c3a35cd-dde7-41cc-915e-73f0af7d4aff tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:57.758240 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6c3a35cd-dde7-41cc-915e-73f0af7d4aff tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:57.758677 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6c3a35cd-dde7-41cc-915e-73f0af7d4aff tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:57.893043 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-15bc6857-dd39-4540-9041-ca361a95feb4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:57.893838 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-15bc6857-dd39-4540-9041-ca361a95feb4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:57.900048 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-15bc6857-dd39-4540-9041-ca361a95feb4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:57.900489 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-15bc6857-dd39-4540-9041-ca361a95feb4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:57.901254 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-15bc6857-dd39-4540-9041-ca361a95feb4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:57.901683 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-15bc6857-dd39-4540-9041-ca361a95feb4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:57.951657 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6c3a35cd-dde7-41cc-915e-73f0af7d4aff tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:57.959868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6c3a35cd-dde7-41cc-915e-73f0af7d4aff tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.217249 Jun 22 18:38:57.959868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 90/173] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:57 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:58.049138 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-15bc6857-dd39-4540-9041-ca361a95feb4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:58.056960 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-15bc6857-dd39-4540-9041-ca361a95feb4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.167834 Jun 22 18:38:58.057541 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 84/174] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:57 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:58.581290 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e17490d1-cab5-46cf-baca-271ab8089136 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:58.581894 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e17490d1-cab5-46cf-baca-271ab8089136 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:58.588048 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e17490d1-cab5-46cf-baca-271ab8089136 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:58.588718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e17490d1-cab5-46cf-baca-271ab8089136 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:58.589780 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e17490d1-cab5-46cf-baca-271ab8089136 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:58.590236 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e17490d1-cab5-46cf-baca-271ab8089136 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:58.736559 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e17490d1-cab5-46cf-baca-271ab8089136 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:58.744243 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e17490d1-cab5-46cf-baca-271ab8089136 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.167496 Jun 22 18:38:58.744796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 91/175] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:58 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:38:58.751392 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bb822854-dd24-4df4-976a-1ea0a21c05fd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:58.752160 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bb822854-dd24-4df4-976a-1ea0a21c05fd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:58.758490 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bb822854-dd24-4df4-976a-1ea0a21c05fd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:58.758925 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bb822854-dd24-4df4-976a-1ea0a21c05fd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:58.759672 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bb822854-dd24-4df4-976a-1ea0a21c05fd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:58.760117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bb822854-dd24-4df4-976a-1ea0a21c05fd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:58.895644 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bb822854-dd24-4df4-976a-1ea0a21c05fd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:58.903457 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bb822854-dd24-4df4-976a-1ea0a21c05fd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:58.904988 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bb822854-dd24-4df4-976a-1ea0a21c05fd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:58.906914 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bb822854-dd24-4df4-976a-1ea0a21c05fd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.162325 Jun 22 18:38:58.907462 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 85/176] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:58 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:38:58.976543 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ff3cd14f-488b-4509-a5be-11ce287ccb3a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:58.977220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ff3cd14f-488b-4509-a5be-11ce287ccb3a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:58.983991 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ff3cd14f-488b-4509-a5be-11ce287ccb3a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:58.984509 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ff3cd14f-488b-4509-a5be-11ce287ccb3a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:58.985358 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ff3cd14f-488b-4509-a5be-11ce287ccb3a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:58.985882 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ff3cd14f-488b-4509-a5be-11ce287ccb3a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:59.074747 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-9fc30ea2-0db7-49bb-a093-8fe6aae8c5ee tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:59.075582 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-9fc30ea2-0db7-49bb-a093-8fe6aae8c5ee tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:59.082466 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9fc30ea2-0db7-49bb-a093-8fe6aae8c5ee tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:59.083018 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9fc30ea2-0db7-49bb-a093-8fe6aae8c5ee tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:59.083777 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9fc30ea2-0db7-49bb-a093-8fe6aae8c5ee tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:59.084411 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9fc30ea2-0db7-49bb-a093-8fe6aae8c5ee tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:59.120957 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ff3cd14f-488b-4509-a5be-11ce287ccb3a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:59.129042 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ff3cd14f-488b-4509-a5be-11ce287ccb3a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.156541 Jun 22 18:38:59.129615 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 92/177] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:58 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:59.220245 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-9fc30ea2-0db7-49bb-a093-8fe6aae8c5ee tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:59.228064 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-9fc30ea2-0db7-49bb-a093-8fe6aae8c5ee tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.157546 Jun 22 18:38:59.228839 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 86/178] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:59 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:59.762666 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-736eaa4b-bb10-4d43-9199-ff3df5a07508 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:59.763254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-736eaa4b-bb10-4d43-9199-ff3df5a07508 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:59.770002 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-736eaa4b-bb10-4d43-9199-ff3df5a07508 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:59.770445 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-736eaa4b-bb10-4d43-9199-ff3df5a07508 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:59.771234 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-736eaa4b-bb10-4d43-9199-ff3df5a07508 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:59.771635 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-736eaa4b-bb10-4d43-9199-ff3df5a07508 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:59.910685 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-736eaa4b-bb10-4d43-9199-ff3df5a07508 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:38:59.918727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-736eaa4b-bb10-4d43-9199-ff3df5a07508 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.160826 Jun 22 18:38:59.919284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 93/179] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:38:59 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:38:59.934486 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-99b996a8-9493-4fbe-8a22-3a1664a00ed9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:38:59.935094 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-99b996a8-9493-4fbe-8a22-3a1664a00ed9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:38:59.941594 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-99b996a8-9493-4fbe-8a22-3a1664a00ed9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:59.942042 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-99b996a8-9493-4fbe-8a22-3a1664a00ed9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:38:59.942805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-99b996a8-9493-4fbe-8a22-3a1664a00ed9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:38:59.943240 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-99b996a8-9493-4fbe-8a22-3a1664a00ed9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:00.083515 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-99b996a8-9493-4fbe-8a22-3a1664a00ed9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:00.094348 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-99b996a8-9493-4fbe-8a22-3a1664a00ed9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:00.096010 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-99b996a8-9493-4fbe-8a22-3a1664a00ed9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:00.097478 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-99b996a8-9493-4fbe-8a22-3a1664a00ed9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.166777 Jun 22 18:39:00.098068 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 87/180] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:38:59 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:00.146213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5b9215f1-33e3-4885-b54d-5b5c7af1e312 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:00.146837 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5b9215f1-33e3-4885-b54d-5b5c7af1e312 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:00.156357 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5b9215f1-33e3-4885-b54d-5b5c7af1e312 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:00.156734 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5b9215f1-33e3-4885-b54d-5b5c7af1e312 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:00.157518 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5b9215f1-33e3-4885-b54d-5b5c7af1e312 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:00.157944 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5b9215f1-33e3-4885-b54d-5b5c7af1e312 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:00.245400 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bb7869d2-386c-4fdc-8306-0b3d5b1e3447 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:00.246003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bb7869d2-386c-4fdc-8306-0b3d5b1e3447 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:00.252990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bb7869d2-386c-4fdc-8306-0b3d5b1e3447 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:00.253700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bb7869d2-386c-4fdc-8306-0b3d5b1e3447 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:00.254764 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bb7869d2-386c-4fdc-8306-0b3d5b1e3447 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:00.255197 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bb7869d2-386c-4fdc-8306-0b3d5b1e3447 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:00.303289 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5b9215f1-33e3-4885-b54d-5b5c7af1e312 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:00.311806 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5b9215f1-33e3-4885-b54d-5b5c7af1e312 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.168998 Jun 22 18:39:00.322381 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 94/181] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:00 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:00.423212 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bb7869d2-386c-4fdc-8306-0b3d5b1e3447 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:00.431576 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bb7869d2-386c-4fdc-8306-0b3d5b1e3447 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.189772 Jun 22 18:39:00.432233 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 88/182] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:00 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:00.937880 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5851ef37-24ca-4edc-b572-01301e189844 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:00.938673 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5851ef37-24ca-4edc-b572-01301e189844 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:00.947374 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5851ef37-24ca-4edc-b572-01301e189844 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:00.947925 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5851ef37-24ca-4edc-b572-01301e189844 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:00.948955 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5851ef37-24ca-4edc-b572-01301e189844 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:00.949579 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5851ef37-24ca-4edc-b572-01301e189844 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:01.096570 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5851ef37-24ca-4edc-b572-01301e189844 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:01.104744 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5851ef37-24ca-4edc-b572-01301e189844 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.171680 Jun 22 18:39:01.105416 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 95/183] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:00 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:01.116307 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-274e21aa-8ff9-496b-a3fc-fd142f49ce3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:01.117543 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-274e21aa-8ff9-496b-a3fc-fd142f49ce3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:01.124471 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-274e21aa-8ff9-496b-a3fc-fd142f49ce3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:01.125077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-274e21aa-8ff9-496b-a3fc-fd142f49ce3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:01.125899 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-274e21aa-8ff9-496b-a3fc-fd142f49ce3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:01.126390 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-274e21aa-8ff9-496b-a3fc-fd142f49ce3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:01.290659 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-274e21aa-8ff9-496b-a3fc-fd142f49ce3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:01.303751 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-274e21aa-8ff9-496b-a3fc-fd142f49ce3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:01.305580 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-274e21aa-8ff9-496b-a3fc-fd142f49ce3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:01.306802 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-274e21aa-8ff9-496b-a3fc-fd142f49ce3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.194451 Jun 22 18:39:01.307429 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 89/184] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:01 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:39:01.330440 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-26c8fb02-c8cd-4077-9530-4bd9cc58aea5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:01.331043 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-26c8fb02-c8cd-4077-9530-4bd9cc58aea5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:01.337016 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26c8fb02-c8cd-4077-9530-4bd9cc58aea5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:01.337456 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26c8fb02-c8cd-4077-9530-4bd9cc58aea5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:01.338212 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26c8fb02-c8cd-4077-9530-4bd9cc58aea5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:01.338636 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26c8fb02-c8cd-4077-9530-4bd9cc58aea5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:01.449385 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a7b54976-48b1-4e11-ae7a-14610af67595 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:01.450083 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a7b54976-48b1-4e11-ae7a-14610af67595 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:01.458751 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a7b54976-48b1-4e11-ae7a-14610af67595 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:01.458751 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a7b54976-48b1-4e11-ae7a-14610af67595 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:01.460304 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a7b54976-48b1-4e11-ae7a-14610af67595 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:01.461072 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a7b54976-48b1-4e11-ae7a-14610af67595 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:01.475617 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-26c8fb02-c8cd-4077-9530-4bd9cc58aea5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:01.485322 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-26c8fb02-c8cd-4077-9530-4bd9cc58aea5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.159859 Jun 22 18:39:01.487028 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 96/185] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:01 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:01.604063 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a7b54976-48b1-4e11-ae7a-14610af67595 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:01.615403 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a7b54976-48b1-4e11-ae7a-14610af67595 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.167096 Jun 22 18:39:01.615403 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 90/186] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:01 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:02.125440 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e1692323-739a-4352-9c55-cb0ac37158ff tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:02.126177 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e1692323-739a-4352-9c55-cb0ac37158ff tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:02.133251 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e1692323-739a-4352-9c55-cb0ac37158ff tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:02.133921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e1692323-739a-4352-9c55-cb0ac37158ff tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:02.134871 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e1692323-739a-4352-9c55-cb0ac37158ff tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:02.135295 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e1692323-739a-4352-9c55-cb0ac37158ff tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:02.273077 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e1692323-739a-4352-9c55-cb0ac37158ff tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:02.281418 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e1692323-739a-4352-9c55-cb0ac37158ff tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.160601 Jun 22 18:39:02.281970 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 97/187] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:02 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:02.324851 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-333e5dc4-5f92-4188-bfa3-23e6f221a1e3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:02.326005 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-333e5dc4-5f92-4188-bfa3-23e6f221a1e3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:02.332290 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-333e5dc4-5f92-4188-bfa3-23e6f221a1e3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:02.332811 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-333e5dc4-5f92-4188-bfa3-23e6f221a1e3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:02.333647 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-333e5dc4-5f92-4188-bfa3-23e6f221a1e3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:02.334149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-333e5dc4-5f92-4188-bfa3-23e6f221a1e3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:02.474249 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-333e5dc4-5f92-4188-bfa3-23e6f221a1e3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:02.482496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-333e5dc4-5f92-4188-bfa3-23e6f221a1e3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:02.484784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-333e5dc4-5f92-4188-bfa3-23e6f221a1e3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:02.485968 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-333e5dc4-5f92-4188-bfa3-23e6f221a1e3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.165165 Jun 22 18:39:02.486603 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 91/188] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:02 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:02.502224 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c4c1d5e1-675a-4ed0-a8a2-c06170edc9aa tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:02.503249 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c4c1d5e1-675a-4ed0-a8a2-c06170edc9aa tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:02.509798 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c4c1d5e1-675a-4ed0-a8a2-c06170edc9aa tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:02.510249 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c4c1d5e1-675a-4ed0-a8a2-c06170edc9aa tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:02.511043 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c4c1d5e1-675a-4ed0-a8a2-c06170edc9aa tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:02.511774 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c4c1d5e1-675a-4ed0-a8a2-c06170edc9aa tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:02.628254 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d050778b-e55d-473d-8b2a-95e04b370179 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:02.628875 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d050778b-e55d-473d-8b2a-95e04b370179 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:02.635863 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d050778b-e55d-473d-8b2a-95e04b370179 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:02.636366 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d050778b-e55d-473d-8b2a-95e04b370179 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:02.637146 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d050778b-e55d-473d-8b2a-95e04b370179 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:02.637577 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d050778b-e55d-473d-8b2a-95e04b370179 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:02.654272 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c4c1d5e1-675a-4ed0-a8a2-c06170edc9aa tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:02.668875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c4c1d5e1-675a-4ed0-a8a2-c06170edc9aa tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.169502 Jun 22 18:39:02.669981 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 98/189] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:02 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:02.824344 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d050778b-e55d-473d-8b2a-95e04b370179 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:02.833186 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d050778b-e55d-473d-8b2a-95e04b370179 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.208726 Jun 22 18:39:02.833930 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 92/190] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:02 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:03.298535 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-098df401-206a-412e-97b9-df535d017285 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:03.299141 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-098df401-206a-412e-97b9-df535d017285 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:03.305233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-098df401-206a-412e-97b9-df535d017285 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:03.305676 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-098df401-206a-412e-97b9-df535d017285 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:03.306437 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-098df401-206a-412e-97b9-df535d017285 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:03.306867 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-098df401-206a-412e-97b9-df535d017285 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:03.442770 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-098df401-206a-412e-97b9-df535d017285 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:03.450193 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-098df401-206a-412e-97b9-df535d017285 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.155606 Jun 22 18:39:03.450844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 99/191] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:03 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:03.504222 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-af2dec39-3fdb-4a4b-ab49-a6fd7e277909 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:03.504829 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-af2dec39-3fdb-4a4b-ab49-a6fd7e277909 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:03.511603 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-af2dec39-3fdb-4a4b-ab49-a6fd7e277909 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:03.512088 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-af2dec39-3fdb-4a4b-ab49-a6fd7e277909 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:03.512854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-af2dec39-3fdb-4a4b-ab49-a6fd7e277909 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:03.513289 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-af2dec39-3fdb-4a4b-ab49-a6fd7e277909 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:03.650355 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-af2dec39-3fdb-4a4b-ab49-a6fd7e277909 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:03.659220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-af2dec39-3fdb-4a4b-ab49-a6fd7e277909 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:03.660760 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-af2dec39-3fdb-4a4b-ab49-a6fd7e277909 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:03.661867 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-af2dec39-3fdb-4a4b-ab49-a6fd7e277909 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.162022 Jun 22 18:39:03.662504 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 93/192] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:03 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:03.686647 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-62b29806-97d2-4368-a91d-f0753831db0d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:03.687293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-62b29806-97d2-4368-a91d-f0753831db0d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:03.694793 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-62b29806-97d2-4368-a91d-f0753831db0d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:03.695663 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-62b29806-97d2-4368-a91d-f0753831db0d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:03.696794 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-62b29806-97d2-4368-a91d-f0753831db0d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:03.697450 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-62b29806-97d2-4368-a91d-f0753831db0d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:03.850323 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5d35b497-62b7-4f0b-a8f6-0955852be781 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:03.851056 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5d35b497-62b7-4f0b-a8f6-0955852be781 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:03.857305 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5d35b497-62b7-4f0b-a8f6-0955852be781 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:03.857737 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5d35b497-62b7-4f0b-a8f6-0955852be781 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:03.858982 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5d35b497-62b7-4f0b-a8f6-0955852be781 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:03.860014 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5d35b497-62b7-4f0b-a8f6-0955852be781 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:03.915455 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-62b29806-97d2-4368-a91d-f0753831db0d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:03.924883 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-62b29806-97d2-4368-a91d-f0753831db0d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.242186 Jun 22 18:39:03.933577 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 100/193] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:03 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:04.053959 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5d35b497-62b7-4f0b-a8f6-0955852be781 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:04.065175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5d35b497-62b7-4f0b-a8f6-0955852be781 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.218393 Jun 22 18:39:04.065710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 94/194] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:03 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:04.468772 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c9fe9da8-9d0b-48a0-a113-15896d833984 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:04.469429 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c9fe9da8-9d0b-48a0-a113-15896d833984 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:04.475814 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c9fe9da8-9d0b-48a0-a113-15896d833984 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:04.476414 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c9fe9da8-9d0b-48a0-a113-15896d833984 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:04.477338 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c9fe9da8-9d0b-48a0-a113-15896d833984 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:04.477774 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c9fe9da8-9d0b-48a0-a113-15896d833984 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:04.612322 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c9fe9da8-9d0b-48a0-a113-15896d833984 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:04.619946 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c9fe9da8-9d0b-48a0-a113-15896d833984 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.155670 Jun 22 18:39:04.620507 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 101/195] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:04 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:04.680530 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-94d0c049-63cb-4b66-abb0-b065f2fe5072 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:04.684211 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-94d0c049-63cb-4b66-abb0-b065f2fe5072 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:04.691282 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94d0c049-63cb-4b66-abb0-b065f2fe5072 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:04.691808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94d0c049-63cb-4b66-abb0-b065f2fe5072 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:04.692702 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94d0c049-63cb-4b66-abb0-b065f2fe5072 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:04.693197 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94d0c049-63cb-4b66-abb0-b065f2fe5072 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:04.697233 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:04.835410 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-94d0c049-63cb-4b66-abb0-b065f2fe5072 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:04.846424 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-94d0c049-63cb-4b66-abb0-b065f2fe5072 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:04.848097 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-94d0c049-63cb-4b66-abb0-b065f2fe5072 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:04.849293 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-94d0c049-63cb-4b66-abb0-b065f2fe5072 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.172686 Jun 22 18:39:04.850211 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 95/196] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:04 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:39:04.941621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3dc33fc1-4c37-4b1b-b3ca-e735f8978c09 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:04.942228 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3dc33fc1-4c37-4b1b-b3ca-e735f8978c09 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:04.948243 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3dc33fc1-4c37-4b1b-b3ca-e735f8978c09 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:04.948692 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3dc33fc1-4c37-4b1b-b3ca-e735f8978c09 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:04.949519 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3dc33fc1-4c37-4b1b-b3ca-e735f8978c09 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:04.949952 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3dc33fc1-4c37-4b1b-b3ca-e735f8978c09 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:04.955471 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=100 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:05.083160 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a6531e0b-0b97-4162-9590-b41a34618bf2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:05.083784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a6531e0b-0b97-4162-9590-b41a34618bf2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:05.088939 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3dc33fc1-4c37-4b1b-b3ca-e735f8978c09 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:05.091133 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6531e0b-0b97-4162-9590-b41a34618bf2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:05.091583 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6531e0b-0b97-4162-9590-b41a34618bf2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:05.092472 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6531e0b-0b97-4162-9590-b41a34618bf2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:05.092915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6531e0b-0b97-4162-9590-b41a34618bf2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:05.096736 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3dc33fc1-4c37-4b1b-b3ca-e735f8978c09 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.158967 Jun 22 18:39:05.097285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 102/197] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:04 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:05.221379 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a6531e0b-0b97-4162-9590-b41a34618bf2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:05.228842 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a6531e0b-0b97-4162-9590-b41a34618bf2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.150656 Jun 22 18:39:05.229411 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 96/198] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:05 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:05.640159 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f1422f40-2f44-4c2a-b36d-518a77cab396 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:05.642024 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f1422f40-2f44-4c2a-b36d-518a77cab396 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:05.648606 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f1422f40-2f44-4c2a-b36d-518a77cab396 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:05.649050 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f1422f40-2f44-4c2a-b36d-518a77cab396 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:05.649818 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f1422f40-2f44-4c2a-b36d-518a77cab396 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:05.650248 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f1422f40-2f44-4c2a-b36d-518a77cab396 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:05.787649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f1422f40-2f44-4c2a-b36d-518a77cab396 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:05.795264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f1422f40-2f44-4c2a-b36d-518a77cab396 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.159442 Jun 22 18:39:05.796558 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 103/199] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:05 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:05.868249 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e4ca68dd-868c-49f2-95ea-c446c506ad23 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:05.868881 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e4ca68dd-868c-49f2-95ea-c446c506ad23 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:05.876516 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e4ca68dd-868c-49f2-95ea-c446c506ad23 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:05.877205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e4ca68dd-868c-49f2-95ea-c446c506ad23 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:05.878511 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e4ca68dd-868c-49f2-95ea-c446c506ad23 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:05.879170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e4ca68dd-868c-49f2-95ea-c446c506ad23 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:06.023863 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e4ca68dd-868c-49f2-95ea-c446c506ad23 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:06.034234 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e4ca68dd-868c-49f2-95ea-c446c506ad23 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:06.035813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e4ca68dd-868c-49f2-95ea-c446c506ad23 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:06.036942 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e4ca68dd-868c-49f2-95ea-c446c506ad23 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.172786 Jun 22 18:39:06.047406 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 97/200] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:05 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:06.113603 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8e9e90f5-6eb1-4dda-a4ca-81f1a1fddb2e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:06.114207 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8e9e90f5-6eb1-4dda-a4ca-81f1a1fddb2e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:06.120562 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8e9e90f5-6eb1-4dda-a4ca-81f1a1fddb2e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:06.121009 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8e9e90f5-6eb1-4dda-a4ca-81f1a1fddb2e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:06.121772 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8e9e90f5-6eb1-4dda-a4ca-81f1a1fddb2e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:06.122205 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8e9e90f5-6eb1-4dda-a4ca-81f1a1fddb2e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:06.245683 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-91b8aa9f-f7ce-434b-b04b-56b957dc4344 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:06.246289 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-91b8aa9f-f7ce-434b-b04b-56b957dc4344 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:06.249566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8e9e90f5-6eb1-4dda-a4ca-81f1a1fddb2e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:06.252744 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91b8aa9f-f7ce-434b-b04b-56b957dc4344 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:06.253303 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91b8aa9f-f7ce-434b-b04b-56b957dc4344 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:06.254064 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91b8aa9f-f7ce-434b-b04b-56b957dc4344 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:06.254492 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91b8aa9f-f7ce-434b-b04b-56b957dc4344 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:06.257082 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8e9e90f5-6eb1-4dda-a4ca-81f1a1fddb2e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.147355 Jun 22 18:39:06.257895 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 104/201] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:06 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:06.381156 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-91b8aa9f-f7ce-434b-b04b-56b957dc4344 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:06.390042 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-91b8aa9f-f7ce-434b-b04b-56b957dc4344 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.147736 Jun 22 18:39:06.390661 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 98/202] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:06 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:06.814084 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-decdab2d-1784-4a7c-9fa4-fe37035dc643 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:06.814678 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-decdab2d-1784-4a7c-9fa4-fe37035dc643 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:06.820722 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-decdab2d-1784-4a7c-9fa4-fe37035dc643 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:06.821159 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-decdab2d-1784-4a7c-9fa4-fe37035dc643 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:06.821907 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-decdab2d-1784-4a7c-9fa4-fe37035dc643 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:06.822331 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-decdab2d-1784-4a7c-9fa4-fe37035dc643 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:06.956523 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-decdab2d-1784-4a7c-9fa4-fe37035dc643 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:06.965232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-decdab2d-1784-4a7c-9fa4-fe37035dc643 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.155838 Jun 22 18:39:06.965800 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 105/203] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:06 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:07.054992 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-8f3ea12a-639b-4216-a977-2e58736920ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:07.055630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-8f3ea12a-639b-4216-a977-2e58736920ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:07.063002 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8f3ea12a-639b-4216-a977-2e58736920ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:07.063002 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8f3ea12a-639b-4216-a977-2e58736920ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:07.063673 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8f3ea12a-639b-4216-a977-2e58736920ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:07.064126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8f3ea12a-639b-4216-a977-2e58736920ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:07.199196 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-8f3ea12a-639b-4216-a977-2e58736920ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:07.207896 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-8f3ea12a-639b-4216-a977-2e58736920ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:07.209406 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-8f3ea12a-639b-4216-a977-2e58736920ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:07.210496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-8f3ea12a-639b-4216-a977-2e58736920ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.159394 Jun 22 18:39:07.211050 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 99/204] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:07 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:07.274625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-474a63fc-87f1-49e7-8c70-3c1c6fa25a5b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:07.275284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-474a63fc-87f1-49e7-8c70-3c1c6fa25a5b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:07.282245 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-474a63fc-87f1-49e7-8c70-3c1c6fa25a5b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:07.282691 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-474a63fc-87f1-49e7-8c70-3c1c6fa25a5b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:07.283461 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-474a63fc-87f1-49e7-8c70-3c1c6fa25a5b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:07.283931 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-474a63fc-87f1-49e7-8c70-3c1c6fa25a5b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:07.407652 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c6270964-a9b1-4577-bec6-57ab29bb09dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:07.408430 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c6270964-a9b1-4577-bec6-57ab29bb09dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:07.414362 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-474a63fc-87f1-49e7-8c70-3c1c6fa25a5b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:07.414534 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c6270964-a9b1-4577-bec6-57ab29bb09dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:07.414978 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c6270964-a9b1-4577-bec6-57ab29bb09dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:07.415825 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c6270964-a9b1-4577-bec6-57ab29bb09dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:07.416335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c6270964-a9b1-4577-bec6-57ab29bb09dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:07.424283 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-474a63fc-87f1-49e7-8c70-3c1c6fa25a5b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.153381 Jun 22 18:39:07.424882 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 106/205] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:07 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:07.545052 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c6270964-a9b1-4577-bec6-57ab29bb09dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:07.552648 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c6270964-a9b1-4577-bec6-57ab29bb09dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.149959 Jun 22 18:39:07.553217 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 100/206] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:07 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:07.982668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-fea12c59-c8b0-4a82-bd18-44191b27116d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:07.983459 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-fea12c59-c8b0-4a82-bd18-44191b27116d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:07.989526 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fea12c59-c8b0-4a82-bd18-44191b27116d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:07.989975 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fea12c59-c8b0-4a82-bd18-44191b27116d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:07.990752 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fea12c59-c8b0-4a82-bd18-44191b27116d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:07.991179 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fea12c59-c8b0-4a82-bd18-44191b27116d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:08.135210 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fea12c59-c8b0-4a82-bd18-44191b27116d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:08.143280 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-fea12c59-c8b0-4a82-bd18-44191b27116d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.164405 Jun 22 18:39:08.144058 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 107/207] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:07 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:08.230023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b736cb7c-6189-4faf-ae6a-9ff58454fd18 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:08.230616 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b736cb7c-6189-4faf-ae6a-9ff58454fd18 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:08.236704 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b736cb7c-6189-4faf-ae6a-9ff58454fd18 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:08.237140 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b736cb7c-6189-4faf-ae6a-9ff58454fd18 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:08.237880 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b736cb7c-6189-4faf-ae6a-9ff58454fd18 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:08.238300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b736cb7c-6189-4faf-ae6a-9ff58454fd18 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:08.370691 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b736cb7c-6189-4faf-ae6a-9ff58454fd18 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:08.382919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b736cb7c-6189-4faf-ae6a-9ff58454fd18 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:08.384454 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b736cb7c-6189-4faf-ae6a-9ff58454fd18 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:08.385557 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b736cb7c-6189-4faf-ae6a-9ff58454fd18 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.159746 Jun 22 18:39:08.386310 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 101/208] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:08 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:08.441361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-550e1a3b-51fc-4bcd-baee-a8ab06950024 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:08.441948 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-550e1a3b-51fc-4bcd-baee-a8ab06950024 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:08.447937 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-550e1a3b-51fc-4bcd-baee-a8ab06950024 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:08.448383 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-550e1a3b-51fc-4bcd-baee-a8ab06950024 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:08.449124 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-550e1a3b-51fc-4bcd-baee-a8ab06950024 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:08.449547 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-550e1a3b-51fc-4bcd-baee-a8ab06950024 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:08.569601 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-da61301e-5850-48af-811a-caa54ffe174b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:08.570116 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-da61301e-5850-48af-811a-caa54ffe174b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:08.576051 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-da61301e-5850-48af-811a-caa54ffe174b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:08.576496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-da61301e-5850-48af-811a-caa54ffe174b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:08.577257 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-da61301e-5850-48af-811a-caa54ffe174b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:08.577687 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-da61301e-5850-48af-811a-caa54ffe174b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:08.578912 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-550e1a3b-51fc-4bcd-baee-a8ab06950024 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:08.586497 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-550e1a3b-51fc-4bcd-baee-a8ab06950024 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.149551 Jun 22 18:39:08.587061 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 108/209] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:08 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:08.711992 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-da61301e-5850-48af-811a-caa54ffe174b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:08.721136 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-da61301e-5850-48af-811a-caa54ffe174b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.155447 Jun 22 18:39:08.721729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 102/210] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:08 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:09.160620 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-441009d5-c4e3-4e7f-a411-947cd28349b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:09.161153 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-441009d5-c4e3-4e7f-a411-947cd28349b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:09.167137 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-441009d5-c4e3-4e7f-a411-947cd28349b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:09.167579 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-441009d5-c4e3-4e7f-a411-947cd28349b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:09.168424 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-441009d5-c4e3-4e7f-a411-947cd28349b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:09.168859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-441009d5-c4e3-4e7f-a411-947cd28349b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:09.302503 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-441009d5-c4e3-4e7f-a411-947cd28349b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:09.309995 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-441009d5-c4e3-4e7f-a411-947cd28349b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.153910 Jun 22 18:39:09.310544 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 109/211] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:09 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:09.405393 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-64fac0c1-6fe0-4561-a9a9-255e0e82956e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:09.406067 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-64fac0c1-6fe0-4561-a9a9-255e0e82956e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:09.412118 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-64fac0c1-6fe0-4561-a9a9-255e0e82956e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:09.412508 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-64fac0c1-6fe0-4561-a9a9-255e0e82956e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:09.413270 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-64fac0c1-6fe0-4561-a9a9-255e0e82956e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:09.413702 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-64fac0c1-6fe0-4561-a9a9-255e0e82956e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:09.540835 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-64fac0c1-6fe0-4561-a9a9-255e0e82956e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:09.548948 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-64fac0c1-6fe0-4561-a9a9-255e0e82956e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:09.550490 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-64fac0c1-6fe0-4561-a9a9-255e0e82956e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:09.551585 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-64fac0c1-6fe0-4561-a9a9-255e0e82956e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.150141 Jun 22 18:39:09.552182 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 103/212] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:09 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:09.603107 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6ecc06d4-e9a0-4b32-af76-6c952d9348b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:09.603702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6ecc06d4-e9a0-4b32-af76-6c952d9348b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:09.609685 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6ecc06d4-e9a0-4b32-af76-6c952d9348b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:09.610120 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6ecc06d4-e9a0-4b32-af76-6c952d9348b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:09.610872 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6ecc06d4-e9a0-4b32-af76-6c952d9348b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:09.611578 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6ecc06d4-e9a0-4b32-af76-6c952d9348b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:09.738946 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c0f00ace-ee7e-49b9-aa16-a1bb1b4e44eb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:09.739543 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c0f00ace-ee7e-49b9-aa16-a1bb1b4e44eb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:09.740381 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6ecc06d4-e9a0-4b32-af76-6c952d9348b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:09.745683 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c0f00ace-ee7e-49b9-aa16-a1bb1b4e44eb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:09.746134 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c0f00ace-ee7e-49b9-aa16-a1bb1b4e44eb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:09.746898 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c0f00ace-ee7e-49b9-aa16-a1bb1b4e44eb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:09.747328 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c0f00ace-ee7e-49b9-aa16-a1bb1b4e44eb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:09.747782 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6ecc06d4-e9a0-4b32-af76-6c952d9348b1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.148483 Jun 22 18:39:09.748963 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 110/213] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:09 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:09.877558 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c0f00ace-ee7e-49b9-aa16-a1bb1b4e44eb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:09.885202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c0f00ace-ee7e-49b9-aa16-a1bb1b4e44eb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.150036 Jun 22 18:39:09.885750 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 104/214] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:09 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:10.326522 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-465c2706-2c67-41d5-8d00-66655c37cffb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:10.327149 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-465c2706-2c67-41d5-8d00-66655c37cffb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:10.334398 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-465c2706-2c67-41d5-8d00-66655c37cffb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:10.334780 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-465c2706-2c67-41d5-8d00-66655c37cffb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:10.335523 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-465c2706-2c67-41d5-8d00-66655c37cffb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:10.335973 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-465c2706-2c67-41d5-8d00-66655c37cffb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:10.459384 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-465c2706-2c67-41d5-8d00-66655c37cffb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:10.466785 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-465c2706-2c67-41d5-8d00-66655c37cffb tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.144076 Jun 22 18:39:10.467334 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 111/215] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:10 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:10.569635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-54b993f7-6823-4a19-9620-19955575c1cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:10.570239 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-54b993f7-6823-4a19-9620-19955575c1cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:10.576340 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-54b993f7-6823-4a19-9620-19955575c1cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:10.576793 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-54b993f7-6823-4a19-9620-19955575c1cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:10.577541 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-54b993f7-6823-4a19-9620-19955575c1cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:10.578580 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-54b993f7-6823-4a19-9620-19955575c1cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:10.704929 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-54b993f7-6823-4a19-9620-19955575c1cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:10.712793 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-54b993f7-6823-4a19-9620-19955575c1cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:10.714291 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-54b993f7-6823-4a19-9620-19955575c1cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:10.715378 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-54b993f7-6823-4a19-9620-19955575c1cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.149805 Jun 22 18:39:10.715953 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 105/216] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:10 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:10.767702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b1521e19-53dc-4211-bdb0-6d02bb7b94ee tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:10.768336 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b1521e19-53dc-4211-bdb0-6d02bb7b94ee tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:10.774390 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b1521e19-53dc-4211-bdb0-6d02bb7b94ee tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:10.774825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b1521e19-53dc-4211-bdb0-6d02bb7b94ee tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:10.775582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b1521e19-53dc-4211-bdb0-6d02bb7b94ee tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:10.776038 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b1521e19-53dc-4211-bdb0-6d02bb7b94ee tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:10.901674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2e18efac-dbba-426f-9415-3ae727e2a937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:10.902272 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2e18efac-dbba-426f-9415-3ae727e2a937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:10.904369 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b1521e19-53dc-4211-bdb0-6d02bb7b94ee tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:10.909303 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2e18efac-dbba-426f-9415-3ae727e2a937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:10.909942 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2e18efac-dbba-426f-9415-3ae727e2a937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:10.910707 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2e18efac-dbba-426f-9415-3ae727e2a937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:10.911133 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2e18efac-dbba-426f-9415-3ae727e2a937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:10.913807 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b1521e19-53dc-4211-bdb0-6d02bb7b94ee tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.150628 Jun 22 18:39:10.914580 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 112/217] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:10 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:11.049278 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2e18efac-dbba-426f-9415-3ae727e2a937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:11.056715 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2e18efac-dbba-426f-9415-3ae727e2a937 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.158822 Jun 22 18:39:11.057280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 106/218] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:10 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:11.483396 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-bbed6a42-e5aa-44bf-bc0d-40154409daa5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:11.484568 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-bbed6a42-e5aa-44bf-bc0d-40154409daa5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:11.490557 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bbed6a42-e5aa-44bf-bc0d-40154409daa5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:11.490993 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bbed6a42-e5aa-44bf-bc0d-40154409daa5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:11.491741 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bbed6a42-e5aa-44bf-bc0d-40154409daa5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:11.492194 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bbed6a42-e5aa-44bf-bc0d-40154409daa5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:11.618799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bbed6a42-e5aa-44bf-bc0d-40154409daa5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:11.626956 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-bbed6a42-e5aa-44bf-bc0d-40154409daa5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.147337 Jun 22 18:39:11.627513 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 113/219] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:11 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:11.734572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-424c9eb4-b086-4c32-8791-a9720813cf9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:11.735654 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-424c9eb4-b086-4c32-8791-a9720813cf9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:11.741621 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-424c9eb4-b086-4c32-8791-a9720813cf9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:11.742062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-424c9eb4-b086-4c32-8791-a9720813cf9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:11.742818 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-424c9eb4-b086-4c32-8791-a9720813cf9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:11.743269 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-424c9eb4-b086-4c32-8791-a9720813cf9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:11.884589 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-424c9eb4-b086-4c32-8791-a9720813cf9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:11.893734 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-424c9eb4-b086-4c32-8791-a9720813cf9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:11.895396 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-424c9eb4-b086-4c32-8791-a9720813cf9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:11.896288 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-09ca2fa5-54a8-4e60-b091-91a1bdf8fecf req-f41851d8-3ec5-4954-9334-1a64e5dba78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab156cb7-09be-4142-be86-0adbd49ae23f", "name": "network-vif-plugged", "status": "completed", "tag": "17ef6483-b512-4263-89ff-3669960db87f"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:39:11.896490 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-424c9eb4-b086-4c32-8791-a9720813cf9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.166456 Jun 22 18:39:11.897232 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 107/220] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:11 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:11.904765 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-09ca2fa5-54a8-4e60-b091-91a1bdf8fecf req-f41851d8-3ec5-4954-9334-1a64e5dba78a service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:11.905397 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-09ca2fa5-54a8-4e60-b091-91a1bdf8fecf req-f41851d8-3ec5-4954-9334-1a64e5dba78a service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:11.919484 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-09ca2fa5-54a8-4e60-b091-91a1bdf8fecf req-f41851d8-3ec5-4954-9334-1a64e5dba78a service nova] Creating event network-vif-plugged:17ef6483-b512-4263-89ff-3669960db87f for instance ab156cb7-09be-4142-be86-0adbd49ae23f on hv-cinder-81268 Jun 22 18:39:11.925047 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-09ca2fa5-54a8-4e60-b091-91a1bdf8fecf req-f41851d8-3ec5-4954-9334-1a64e5dba78a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033211 Jun 22 18:39:11.925813 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 114/221] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:39:11.931321 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bd193582-6be3-4db0-a9a2-8341b3b43f1b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:11.931972 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bd193582-6be3-4db0-a9a2-8341b3b43f1b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:11.938548 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bd193582-6be3-4db0-a9a2-8341b3b43f1b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:11.938990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bd193582-6be3-4db0-a9a2-8341b3b43f1b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:11.939745 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bd193582-6be3-4db0-a9a2-8341b3b43f1b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:11.940195 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bd193582-6be3-4db0-a9a2-8341b3b43f1b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:12.067549 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bd193582-6be3-4db0-a9a2-8341b3b43f1b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:12.074501 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8fb49b69-6815-4f20-b3a1-21fbc7e198a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:12.075050 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bd193582-6be3-4db0-a9a2-8341b3b43f1b tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.147656 Jun 22 18:39:12.075330 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8fb49b69-6815-4f20-b3a1-21fbc7e198a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:12.075609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 108/222] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:11 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:12.082528 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8fb49b69-6815-4f20-b3a1-21fbc7e198a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:12.083413 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8fb49b69-6815-4f20-b3a1-21fbc7e198a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:12.084214 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8fb49b69-6815-4f20-b3a1-21fbc7e198a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:12.084651 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8fb49b69-6815-4f20-b3a1-21fbc7e198a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:12.213726 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8fb49b69-6815-4f20-b3a1-21fbc7e198a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:12.221391 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8fb49b69-6815-4f20-b3a1-21fbc7e198a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.151053 Jun 22 18:39:12.221959 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 115/223] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:12 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:12.644606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-10f1f7cb-e8af-40ac-992d-129b9f2abb7c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:12.645137 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-10f1f7cb-e8af-40ac-992d-129b9f2abb7c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:12.651137 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-10f1f7cb-e8af-40ac-992d-129b9f2abb7c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:12.651584 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-10f1f7cb-e8af-40ac-992d-129b9f2abb7c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:12.652373 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-10f1f7cb-e8af-40ac-992d-129b9f2abb7c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:12.652808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-10f1f7cb-e8af-40ac-992d-129b9f2abb7c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:12.782006 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-10f1f7cb-e8af-40ac-992d-129b9f2abb7c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:12.789380 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-10f1f7cb-e8af-40ac-992d-129b9f2abb7c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.149040 Jun 22 18:39:12.789943 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 109/224] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:12 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:12.915883 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f9f7a9f2-49a1-4803-b9b4-dc307df7c3a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:12.917003 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f9f7a9f2-49a1-4803-b9b4-dc307df7c3a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:12.924350 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f9f7a9f2-49a1-4803-b9b4-dc307df7c3a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:12.924801 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f9f7a9f2-49a1-4803-b9b4-dc307df7c3a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:12.925569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f9f7a9f2-49a1-4803-b9b4-dc307df7c3a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:12.925994 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f9f7a9f2-49a1-4803-b9b4-dc307df7c3a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:13.095146 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d3df8bb8-5eaa-486d-8884-d2de239c7611 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:13.095772 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d3df8bb8-5eaa-486d-8884-d2de239c7611 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:13.102768 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d3df8bb8-5eaa-486d-8884-d2de239c7611 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:13.103207 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d3df8bb8-5eaa-486d-8884-d2de239c7611 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:13.107034 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d3df8bb8-5eaa-486d-8884-d2de239c7611 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:13.107034 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d3df8bb8-5eaa-486d-8884-d2de239c7611 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:13.347631 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f9f7a9f2-49a1-4803-b9b4-dc307df7c3a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:13.360977 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f9f7a9f2-49a1-4803-b9b4-dc307df7c3a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:13.362578 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f9f7a9f2-49a1-4803-b9b4-dc307df7c3a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:13.363634 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f9f7a9f2-49a1-4803-b9b4-dc307df7c3a2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.452198 Jun 22 18:39:13.369052 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 116/225] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:12 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:13.378693 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cc703fc4-167e-424b-8b4f-793d31eba77c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:13.379569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cc703fc4-167e-424b-8b4f-793d31eba77c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:13.391892 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc703fc4-167e-424b-8b4f-793d31eba77c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:13.392508 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc703fc4-167e-424b-8b4f-793d31eba77c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:13.393317 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc703fc4-167e-424b-8b4f-793d31eba77c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:13.393842 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc703fc4-167e-424b-8b4f-793d31eba77c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:13.548756 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cc703fc4-167e-424b-8b4f-793d31eba77c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:13.560006 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cc703fc4-167e-424b-8b4f-793d31eba77c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.189011 Jun 22 18:39:13.561006 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 117/226] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:13 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:13.574982 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-815475543", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "networks": [{"uuid": "a77cb063-35a2-4e3d-ae37-3ec6bbaffdb8"}]}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:39:13.633957 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.network.neutron [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] validate_networks() for [('a77cb063-35a2-4e3d-ae37-3ec6bbaffdb8', None, None, None, None, None)] {{(pid=129744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:39:14.072706 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d3df8bb8-5eaa-486d-8884-d2de239c7611 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:14.088994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d3df8bb8-5eaa-486d-8884-d2de239c7611 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.997345 Jun 22 18:39:14.089968 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 110/227] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:13 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:14.103887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-8fb1d207-ceaf-461c-83a1-7bbba065850d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:14.104652 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-8fb1d207-ceaf-461c-83a1-7bbba065850d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:14.124120 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8fb1d207-ceaf-461c-83a1-7bbba065850d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:14.124715 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8fb1d207-ceaf-461c-83a1-7bbba065850d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:14.125547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8fb1d207-ceaf-461c-83a1-7bbba065850d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:14.125937 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8fb1d207-ceaf-461c-83a1-7bbba065850d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:14.217411 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Flavor limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:39:14.217909 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Image limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:39:14.219068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Flavor pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:39:14.219745 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Image pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:39:14.220250 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:39:14.230839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:14.231381 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:14.232270 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:14.233005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:14.272279 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Getting quotas for project ffb5e6607fb843bca3fb4a6ae694d47e. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:39:14.277029 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Getting quotas for user e671d76c5e5b4d528310abedb603d16d and project ffb5e6607fb843bca3fb4a6ae694d47e. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:39:14.285978 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-8fb1d207-ceaf-461c-83a1-7bbba065850d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:14.289463 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:14.291622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Going to run 1 instances... {{(pid=129744) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:39:14.294461 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:39:14.295297 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-8fb1d207-ceaf-461c-83a1-7bbba065850d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.203058 Jun 22 18:39:14.295894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 111/228] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:14 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:14.347865 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-19f6dae5-7ccc-4683-8447-719c573101d0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785591 Jun 22 18:39:14.351405 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 118/229] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:39:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:39:14.359482 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-44241844-3d29-46b7-927d-83a56c26bd86 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:14.360386 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-44241844-3d29-46b7-927d-83a56c26bd86 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:14.387072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1897a653-9856-4943-8671-5d5cd3f025ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:14.387675 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-1897a653-9856-4943-8671-5d5cd3f025ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:14.409419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1897a653-9856-4943-8671-5d5cd3f025ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:14.410004 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1897a653-9856-4943-8671-5d5cd3f025ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:14.410799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1897a653-9856-4943-8671-5d5cd3f025ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:14.411885 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1897a653-9856-4943-8671-5d5cd3f025ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:14.554225 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-44241844-3d29-46b7-927d-83a56c26bd86 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:14.574226 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-44241844-3d29-46b7-927d-83a56c26bd86 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1213 microversion: 2.1 time: 0.219244 Jun 22 18:39:14.575075 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 112/230] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:14 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1213 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:14.582042 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7d77e6e0-9bcc-43a4-bdbc-045f53f1f749 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:14.582882 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7d77e6e0-9bcc-43a4-bdbc-045f53f1f749 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:14.606561 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7d77e6e0-9bcc-43a4-bdbc-045f53f1f749 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:14.607216 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7d77e6e0-9bcc-43a4-bdbc-045f53f1f749 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:14.609609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7d77e6e0-9bcc-43a4-bdbc-045f53f1f749 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:14.613008 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7d77e6e0-9bcc-43a4-bdbc-045f53f1f749 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:14.613839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-1897a653-9856-4943-8671-5d5cd3f025ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:14.625956 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-1897a653-9856-4943-8671-5d5cd3f025ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:14.630411 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-1897a653-9856-4943-8671-5d5cd3f025ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:14.631969 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-1897a653-9856-4943-8671-5d5cd3f025ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.249016 Jun 22 18:39:14.648071 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 119/231] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:14 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:39:14.862516 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7d77e6e0-9bcc-43a4-bdbc-045f53f1f749 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:14.871688 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7d77e6e0-9bcc-43a4-bdbc-045f53f1f749 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.294803 Jun 22 18:39:14.872528 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 113/232] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:14 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:15.106418 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ef5bfe47-1bf6-4630-9032-e22f202a9ee6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:15.107011 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ef5bfe47-1bf6-4630-9032-e22f202a9ee6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:15.113860 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ef5bfe47-1bf6-4630-9032-e22f202a9ee6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:15.114302 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ef5bfe47-1bf6-4630-9032-e22f202a9ee6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:15.115061 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ef5bfe47-1bf6-4630-9032-e22f202a9ee6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:15.115484 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ef5bfe47-1bf6-4630-9032-e22f202a9ee6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:15.119544 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=100 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:15.268918 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ef5bfe47-1bf6-4630-9032-e22f202a9ee6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:15.277896 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ef5bfe47-1bf6-4630-9032-e22f202a9ee6 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.175399 Jun 22 18:39:15.278476 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 120/233] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:15 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:15.313824 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ddd4093a-6229-44c2-8ba6-1520f60fa9a9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:15.315006 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ddd4093a-6229-44c2-8ba6-1520f60fa9a9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:15.321279 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ddd4093a-6229-44c2-8ba6-1520f60fa9a9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:15.321724 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ddd4093a-6229-44c2-8ba6-1520f60fa9a9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:15.322491 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ddd4093a-6229-44c2-8ba6-1520f60fa9a9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:15.322975 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ddd4093a-6229-44c2-8ba6-1520f60fa9a9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:15.459473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ddd4093a-6229-44c2-8ba6-1520f60fa9a9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:15.467538 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ddd4093a-6229-44c2-8ba6-1520f60fa9a9 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.157958 Jun 22 18:39:15.468071 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 114/234] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:15 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:15.591809 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a5925898-3cdc-4e97-9188-182d17755d7c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:15.592433 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a5925898-3cdc-4e97-9188-182d17755d7c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:15.599091 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a5925898-3cdc-4e97-9188-182d17755d7c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:15.599722 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a5925898-3cdc-4e97-9188-182d17755d7c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:15.600506 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a5925898-3cdc-4e97-9188-182d17755d7c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:15.600930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a5925898-3cdc-4e97-9188-182d17755d7c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:15.652899 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bea743f6-2793-469a-ab81-36b8dcb2db13 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:15.653529 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bea743f6-2793-469a-ab81-36b8dcb2db13 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:15.660869 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bea743f6-2793-469a-ab81-36b8dcb2db13 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:15.661311 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bea743f6-2793-469a-ab81-36b8dcb2db13 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:15.662084 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bea743f6-2793-469a-ab81-36b8dcb2db13 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:15.662514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bea743f6-2793-469a-ab81-36b8dcb2db13 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:15.666664 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a5925898-3cdc-4e97-9188-182d17755d7c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:15.674739 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a5925898-3cdc-4e97-9188-182d17755d7c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1217 microversion: 2.1 time: 0.086505 Jun 22 18:39:15.675465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 121/235] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:15 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:15.840749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bea743f6-2793-469a-ab81-36b8dcb2db13 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:15.851114 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bea743f6-2793-469a-ab81-36b8dcb2db13 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:15.853286 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bea743f6-2793-469a-ab81-36b8dcb2db13 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:15.854565 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bea743f6-2793-469a-ab81-36b8dcb2db13 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.205755 Jun 22 18:39:15.855303 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 115/236] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:15 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:39:15.889678 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-767d9285-b372-4d4b-b2a8-f14bec62ac24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:15.891443 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-767d9285-b372-4d4b-b2a8-f14bec62ac24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:15.897617 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-767d9285-b372-4d4b-b2a8-f14bec62ac24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:15.898315 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-767d9285-b372-4d4b-b2a8-f14bec62ac24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:15.899291 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-767d9285-b372-4d4b-b2a8-f14bec62ac24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:15.899945 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-767d9285-b372-4d4b-b2a8-f14bec62ac24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:15.910368 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-d807fab8-8dd8-4fb9-91d6-9dc77756c19b req-6f72aa43-7fca-4ea6-834d-2a101a3419a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5414be47-8679-4c15-9b75-4da9d4d9ac1b", "name": "network-vif-plugged", "status": "completed", "tag": "398742f5-c1a9-424d-9b37-ae5ab7336f30"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:39:15.924921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-d807fab8-8dd8-4fb9-91d6-9dc77756c19b req-6f72aa43-7fca-4ea6-834d-2a101a3419a9 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:15.925458 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-d807fab8-8dd8-4fb9-91d6-9dc77756c19b req-6f72aa43-7fca-4ea6-834d-2a101a3419a9 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:15.939299 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-d807fab8-8dd8-4fb9-91d6-9dc77756c19b req-6f72aa43-7fca-4ea6-834d-2a101a3419a9 service nova] Creating event network-vif-plugged:398742f5-c1a9-424d-9b37-ae5ab7336f30 for instance 5414be47-8679-4c15-9b75-4da9d4d9ac1b on hv-cinder-81268 Jun 22 18:39:15.945355 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-d807fab8-8dd8-4fb9-91d6-9dc77756c19b req-6f72aa43-7fca-4ea6-834d-2a101a3419a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038138 Jun 22 18:39:15.946529 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 116/237] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:39:16.051769 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-767d9285-b372-4d4b-b2a8-f14bec62ac24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:16.059496 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-767d9285-b372-4d4b-b2a8-f14bec62ac24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.173511 Jun 22 18:39:16.060108 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 122/238] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:15 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:16.295085 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bf6b0584-8923-4275-b5c0-6625a7bf3a07 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:16.295781 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bf6b0584-8923-4275-b5c0-6625a7bf3a07 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:16.307149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bf6b0584-8923-4275-b5c0-6625a7bf3a07 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:16.307586 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bf6b0584-8923-4275-b5c0-6625a7bf3a07 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:16.310218 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bf6b0584-8923-4275-b5c0-6625a7bf3a07 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:16.310662 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bf6b0584-8923-4275-b5c0-6625a7bf3a07 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:16.454278 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bf6b0584-8923-4275-b5c0-6625a7bf3a07 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:16.461692 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bf6b0584-8923-4275-b5c0-6625a7bf3a07 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.170764 Jun 22 18:39:16.462262 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 117/239] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:16 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:16.485063 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ab349e78-c989-498c-9593-6582ea688288 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:16.485604 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ab349e78-c989-498c-9593-6582ea688288 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:16.492601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ab349e78-c989-498c-9593-6582ea688288 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:16.493213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ab349e78-c989-498c-9593-6582ea688288 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:16.494037 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ab349e78-c989-498c-9593-6582ea688288 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:16.494496 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ab349e78-c989-498c-9593-6582ea688288 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:16.631025 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ab349e78-c989-498c-9593-6582ea688288 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:16.642158 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ab349e78-c989-498c-9593-6582ea688288 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.160818 Jun 22 18:39:16.646297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 123/240] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:16 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:16.692294 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a372d352-386b-456d-b314-530e7e334a90 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:16.692896 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a372d352-386b-456d-b314-530e7e334a90 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:16.698943 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a372d352-386b-456d-b314-530e7e334a90 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:16.699390 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a372d352-386b-456d-b314-530e7e334a90 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:16.700175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a372d352-386b-456d-b314-530e7e334a90 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:16.700602 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a372d352-386b-456d-b314-530e7e334a90 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:16.764183 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a372d352-386b-456d-b314-530e7e334a90 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:16.772496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a372d352-386b-456d-b314-530e7e334a90 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1217 microversion: 2.1 time: 0.083995 Jun 22 18:39:16.781708 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 118/241] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:16 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:16.874192 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-11f29fbf-9108-4a25-9da3-4bf1b05cee19 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:16.875574 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-11f29fbf-9108-4a25-9da3-4bf1b05cee19 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:16.881695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-11f29fbf-9108-4a25-9da3-4bf1b05cee19 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:16.882134 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-11f29fbf-9108-4a25-9da3-4bf1b05cee19 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:16.883143 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-11f29fbf-9108-4a25-9da3-4bf1b05cee19 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:16.883572 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-11f29fbf-9108-4a25-9da3-4bf1b05cee19 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:17.016233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-11f29fbf-9108-4a25-9da3-4bf1b05cee19 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:17.029421 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-11f29fbf-9108-4a25-9da3-4bf1b05cee19 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:17.031998 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-11f29fbf-9108-4a25-9da3-4bf1b05cee19 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:17.033250 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-11f29fbf-9108-4a25-9da3-4bf1b05cee19 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.162913 Jun 22 18:39:17.033874 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 124/242] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:16 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:17.076552 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-12f8bd20-aef1-4bad-89af-d82337826c46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:17.077506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-12f8bd20-aef1-4bad-89af-d82337826c46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:17.086598 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-12f8bd20-aef1-4bad-89af-d82337826c46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:17.087081 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-12f8bd20-aef1-4bad-89af-d82337826c46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:17.087952 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-12f8bd20-aef1-4bad-89af-d82337826c46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:17.088794 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-12f8bd20-aef1-4bad-89af-d82337826c46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:17.224238 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-12f8bd20-aef1-4bad-89af-d82337826c46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:17.235099 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-12f8bd20-aef1-4bad-89af-d82337826c46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.161159 Jun 22 18:39:17.235685 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 119/243] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:17 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:17.478464 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d389c623-17ac-4cc9-a793-9519aca37e37 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:17.479169 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d389c623-17ac-4cc9-a793-9519aca37e37 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:17.485740 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d389c623-17ac-4cc9-a793-9519aca37e37 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:17.486290 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d389c623-17ac-4cc9-a793-9519aca37e37 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:17.486933 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d389c623-17ac-4cc9-a793-9519aca37e37 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:17.487359 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d389c623-17ac-4cc9-a793-9519aca37e37 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:17.627776 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d389c623-17ac-4cc9-a793-9519aca37e37 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:17.640193 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d389c623-17ac-4cc9-a793-9519aca37e37 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.161812 Jun 22 18:39:17.640193 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 125/244] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:17 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:17.662842 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c33bf432-56b5-407c-9043-a65495c8fbc7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:17.663431 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c33bf432-56b5-407c-9043-a65495c8fbc7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:17.670044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c33bf432-56b5-407c-9043-a65495c8fbc7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:17.670685 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c33bf432-56b5-407c-9043-a65495c8fbc7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:17.672143 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c33bf432-56b5-407c-9043-a65495c8fbc7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:17.672900 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c33bf432-56b5-407c-9043-a65495c8fbc7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:17.791582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-790417b4-d42c-44fd-879a-f0bab41b9e10 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:17.792313 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-790417b4-d42c-44fd-879a-f0bab41b9e10 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:17.799580 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-790417b4-d42c-44fd-879a-f0bab41b9e10 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:17.800134 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-790417b4-d42c-44fd-879a-f0bab41b9e10 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:17.800973 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-790417b4-d42c-44fd-879a-f0bab41b9e10 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:17.801472 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-790417b4-d42c-44fd-879a-f0bab41b9e10 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:17.825415 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c33bf432-56b5-407c-9043-a65495c8fbc7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:17.835457 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c33bf432-56b5-407c-9043-a65495c8fbc7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.176364 Jun 22 18:39:17.836241 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 120/245] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:17 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:17.879462 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-790417b4-d42c-44fd-879a-f0bab41b9e10 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:17.888743 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-790417b4-d42c-44fd-879a-f0bab41b9e10 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1217 microversion: 2.1 time: 0.101895 Jun 22 18:39:17.898742 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 126/246] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:17 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:18.052291 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a6889344-3196-4089-be0c-159640f2da29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:18.052891 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a6889344-3196-4089-be0c-159640f2da29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:18.058964 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6889344-3196-4089-be0c-159640f2da29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:18.059408 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6889344-3196-4089-be0c-159640f2da29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:18.060213 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6889344-3196-4089-be0c-159640f2da29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:18.060647 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6889344-3196-4089-be0c-159640f2da29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:18.200229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a6889344-3196-4089-be0c-159640f2da29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:18.209558 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a6889344-3196-4089-be0c-159640f2da29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:18.211064 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a6889344-3196-4089-be0c-159640f2da29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:18.212192 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a6889344-3196-4089-be0c-159640f2da29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.163833 Jun 22 18:39:18.212757 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 121/247] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:18 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:18.256363 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d2b6ea7c-4f7d-49af-9aba-3ad1d6374127 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:18.256959 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d2b6ea7c-4f7d-49af-9aba-3ad1d6374127 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:18.263431 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d2b6ea7c-4f7d-49af-9aba-3ad1d6374127 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:18.263903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d2b6ea7c-4f7d-49af-9aba-3ad1d6374127 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:18.264658 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d2b6ea7c-4f7d-49af-9aba-3ad1d6374127 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:18.265949 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d2b6ea7c-4f7d-49af-9aba-3ad1d6374127 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:18.399143 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d2b6ea7c-4f7d-49af-9aba-3ad1d6374127 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:18.407306 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d2b6ea7c-4f7d-49af-9aba-3ad1d6374127 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.154822 Jun 22 18:39:18.407889 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 127/248] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:18 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:18.653168 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e440b031-4df1-422d-b457-7c9538d6c570 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:18.653680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e440b031-4df1-422d-b457-7c9538d6c570 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:18.660548 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e440b031-4df1-422d-b457-7c9538d6c570 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:18.660991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e440b031-4df1-422d-b457-7c9538d6c570 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:18.661750 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e440b031-4df1-422d-b457-7c9538d6c570 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:18.662173 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e440b031-4df1-422d-b457-7c9538d6c570 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:18.806015 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e440b031-4df1-422d-b457-7c9538d6c570 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:18.813559 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e440b031-4df1-422d-b457-7c9538d6c570 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.164288 Jun 22 18:39:18.814118 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 122/249] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:18 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:18.859608 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ab90e720-4ff6-405d-a9f6-3366897a0b89 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:18.860228 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ab90e720-4ff6-405d-a9f6-3366897a0b89 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:18.866340 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ab90e720-4ff6-405d-a9f6-3366897a0b89 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:18.866778 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ab90e720-4ff6-405d-a9f6-3366897a0b89 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:18.867527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ab90e720-4ff6-405d-a9f6-3366897a0b89 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:18.867983 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ab90e720-4ff6-405d-a9f6-3366897a0b89 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:18.907334 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7d2aeb71-3e94-4c83-a03f-008b1c90fa76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:18.907978 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7d2aeb71-3e94-4c83-a03f-008b1c90fa76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:18.910992 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:18.914401 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7d2aeb71-3e94-4c83-a03f-008b1c90fa76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:18.914838 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7d2aeb71-3e94-4c83-a03f-008b1c90fa76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:18.915602 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7d2aeb71-3e94-4c83-a03f-008b1c90fa76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:18.916057 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7d2aeb71-3e94-4c83-a03f-008b1c90fa76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:18.976599 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7d2aeb71-3e94-4c83-a03f-008b1c90fa76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:18.985129 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7d2aeb71-3e94-4c83-a03f-008b1c90fa76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1217 microversion: 2.1 time: 0.081728 Jun 22 18:39:18.985716 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 123/250] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:18 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:18.997641 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ab90e720-4ff6-405d-a9f6-3366897a0b89 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:19.005616 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ab90e720-4ff6-405d-a9f6-3366897a0b89 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.149871 Jun 22 18:39:19.006163 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 128/251] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:18 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:19.232515 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-94f61469-d7d2-42ed-8799-2dcd2d0fc599 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:19.233076 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-94f61469-d7d2-42ed-8799-2dcd2d0fc599 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:19.239214 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94f61469-d7d2-42ed-8799-2dcd2d0fc599 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:19.239659 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94f61469-d7d2-42ed-8799-2dcd2d0fc599 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:19.240468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94f61469-d7d2-42ed-8799-2dcd2d0fc599 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:19.240968 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94f61469-d7d2-42ed-8799-2dcd2d0fc599 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:19.368164 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-94f61469-d7d2-42ed-8799-2dcd2d0fc599 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:19.376590 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-94f61469-d7d2-42ed-8799-2dcd2d0fc599 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:19.378090 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-94f61469-d7d2-42ed-8799-2dcd2d0fc599 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:19.379165 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-94f61469-d7d2-42ed-8799-2dcd2d0fc599 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.150621 Jun 22 18:39:19.379719 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 124/252] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:19 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:19.423660 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-68e3361f-ea73-4e09-8330-b5a2b19dd322 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:19.424664 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-68e3361f-ea73-4e09-8330-b5a2b19dd322 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:19.431134 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-68e3361f-ea73-4e09-8330-b5a2b19dd322 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:19.431886 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-68e3361f-ea73-4e09-8330-b5a2b19dd322 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:19.432999 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-68e3361f-ea73-4e09-8330-b5a2b19dd322 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:19.433624 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-68e3361f-ea73-4e09-8330-b5a2b19dd322 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:19.602521 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-68e3361f-ea73-4e09-8330-b5a2b19dd322 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:19.612102 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-68e3361f-ea73-4e09-8330-b5a2b19dd322 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.192902 Jun 22 18:39:19.613135 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 129/253] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:19 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:19.830626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bce42d64-c957-4e56-9857-d0e448b2a1d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:19.831237 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bce42d64-c957-4e56-9857-d0e448b2a1d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:19.844710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bce42d64-c957-4e56-9857-d0e448b2a1d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:19.844710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bce42d64-c957-4e56-9857-d0e448b2a1d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:19.844710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bce42d64-c957-4e56-9857-d0e448b2a1d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:19.844710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bce42d64-c957-4e56-9857-d0e448b2a1d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:20.002782 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-89b8d926-9a7b-460b-9405-6b5566cdb11e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:20.003391 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-89b8d926-9a7b-460b-9405-6b5566cdb11e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:20.013452 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-89b8d926-9a7b-460b-9405-6b5566cdb11e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:20.013965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-89b8d926-9a7b-460b-9405-6b5566cdb11e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:20.015531 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-89b8d926-9a7b-460b-9405-6b5566cdb11e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:20.016441 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-89b8d926-9a7b-460b-9405-6b5566cdb11e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:20.056345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bce42d64-c957-4e56-9857-d0e448b2a1d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:20.065802 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bce42d64-c957-4e56-9857-d0e448b2a1d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.238930 Jun 22 18:39:20.066388 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 125/254] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:19 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:20.080442 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e340f0d8-81b9-4531-9f30-2ac8c2790765 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:20.081053 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e340f0d8-81b9-4531-9f30-2ac8c2790765 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:20.087596 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e340f0d8-81b9-4531-9f30-2ac8c2790765 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:20.088484 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e340f0d8-81b9-4531-9f30-2ac8c2790765 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:20.089483 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e340f0d8-81b9-4531-9f30-2ac8c2790765 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:20.090102 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e340f0d8-81b9-4531-9f30-2ac8c2790765 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:20.105322 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-89b8d926-9a7b-460b-9405-6b5566cdb11e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:20.117735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-89b8d926-9a7b-460b-9405-6b5566cdb11e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1209 microversion: 2.1 time: 0.119120 Jun 22 18:39:20.118819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 130/255] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:19 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1209 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:20.277196 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e340f0d8-81b9-4531-9f30-2ac8c2790765 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:20.286336 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e340f0d8-81b9-4531-9f30-2ac8c2790765 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.210296 Jun 22 18:39:20.286919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 126/256] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:20 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:20.397362 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-db35b88f-35e4-444a-be5d-ccdfaf51dfc3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:20.397961 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-db35b88f-35e4-444a-be5d-ccdfaf51dfc3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:20.403345 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:20.406048 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-db35b88f-35e4-444a-be5d-ccdfaf51dfc3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:20.406504 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-db35b88f-35e4-444a-be5d-ccdfaf51dfc3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:20.407274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-db35b88f-35e4-444a-be5d-ccdfaf51dfc3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:20.407874 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-db35b88f-35e4-444a-be5d-ccdfaf51dfc3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:20.412903 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-9ef55dc0-bf40-4465-9bd2-7cc842db302a req-806d4bd4-bcb4-460b-86ae-a588c74f71ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a9799ba-7e8d-4145-b942-752d45813cfc", "name": "network-vif-plugged", "status": "completed", "tag": "ff5e1751-3636-44a9-8f6a-879586f4b3a2"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:39:20.427699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-9ef55dc0-bf40-4465-9bd2-7cc842db302a req-806d4bd4-bcb4-460b-86ae-a588c74f71ca service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:20.428596 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-9ef55dc0-bf40-4465-9bd2-7cc842db302a req-806d4bd4-bcb4-460b-86ae-a588c74f71ca service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:20.456750 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-9ef55dc0-bf40-4465-9bd2-7cc842db302a req-806d4bd4-bcb4-460b-86ae-a588c74f71ca service nova] Creating event network-vif-plugged:ff5e1751-3636-44a9-8f6a-879586f4b3a2 for instance 2a9799ba-7e8d-4145-b942-752d45813cfc on hv-cinder-81268 Jun 22 18:39:20.463606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-9ef55dc0-bf40-4465-9bd2-7cc842db302a req-806d4bd4-bcb4-460b-86ae-a588c74f71ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054156 Jun 22 18:39:20.464914 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 127/257] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:39:20.553505 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-db35b88f-35e4-444a-be5d-ccdfaf51dfc3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:20.561829 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-db35b88f-35e4-444a-be5d-ccdfaf51dfc3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:20.563441 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-db35b88f-35e4-444a-be5d-ccdfaf51dfc3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:20.564577 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-db35b88f-35e4-444a-be5d-ccdfaf51dfc3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.171178 Jun 22 18:39:20.565120 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 131/258] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:20 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:20.629617 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4a9bca13-4c7f-4d19-b236-f9692a822feb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:20.630301 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-4a9bca13-4c7f-4d19-b236-f9692a822feb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:20.636852 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4a9bca13-4c7f-4d19-b236-f9692a822feb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:20.637294 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4a9bca13-4c7f-4d19-b236-f9692a822feb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:20.638117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4a9bca13-4c7f-4d19-b236-f9692a822feb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:20.638554 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4a9bca13-4c7f-4d19-b236-f9692a822feb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:20.794765 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4a9bca13-4c7f-4d19-b236-f9692a822feb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:20.806370 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4a9bca13-4c7f-4d19-b236-f9692a822feb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.181153 Jun 22 18:39:20.806947 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 128/259] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:20 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:21.082416 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5829813d-3b95-4d72-9763-60a8fa67ca93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:21.083015 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5829813d-3b95-4d72-9763-60a8fa67ca93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:21.088973 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5829813d-3b95-4d72-9763-60a8fa67ca93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:21.089414 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5829813d-3b95-4d72-9763-60a8fa67ca93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:21.090164 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5829813d-3b95-4d72-9763-60a8fa67ca93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:21.090585 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5829813d-3b95-4d72-9763-60a8fa67ca93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:21.137626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3ababdf0-e132-4bae-882c-ce4b2d84ce5c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:21.138272 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3ababdf0-e132-4bae-882c-ce4b2d84ce5c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:21.145128 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3ababdf0-e132-4bae-882c-ce4b2d84ce5c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:21.145128 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3ababdf0-e132-4bae-882c-ce4b2d84ce5c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:21.145128 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3ababdf0-e132-4bae-882c-ce4b2d84ce5c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:21.147154 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3ababdf0-e132-4bae-882c-ce4b2d84ce5c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:21.222230 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3ababdf0-e132-4bae-882c-ce4b2d84ce5c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:21.229902 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3ababdf0-e132-4bae-882c-ce4b2d84ce5c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1209 microversion: 2.1 time: 0.097656 Jun 22 18:39:21.230478 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 129/260] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:21 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:21.233051 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5829813d-3b95-4d72-9763-60a8fa67ca93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:21.242633 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5829813d-3b95-4d72-9763-60a8fa67ca93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.163843 Jun 22 18:39:21.243450 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 132/261] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:21 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:21.302439 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-30f5f06f-7466-4c82-be6f-39b8ce3e1798 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:21.303056 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-30f5f06f-7466-4c82-be6f-39b8ce3e1798 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:21.309064 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-30f5f06f-7466-4c82-be6f-39b8ce3e1798 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:21.309506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-30f5f06f-7466-4c82-be6f-39b8ce3e1798 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:21.310263 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-30f5f06f-7466-4c82-be6f-39b8ce3e1798 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:21.310695 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-30f5f06f-7466-4c82-be6f-39b8ce3e1798 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:21.443890 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-30f5f06f-7466-4c82-be6f-39b8ce3e1798 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:21.447426 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:21.452696 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-30f5f06f-7466-4c82-be6f-39b8ce3e1798 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.153717 Jun 22 18:39:21.453286 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 130/262] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:21 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:21.582823 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0e136225-6920-4ab8-b17a-84eecfbc1272 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:21.583498 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0e136225-6920-4ab8-b17a-84eecfbc1272 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:21.589612 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0e136225-6920-4ab8-b17a-84eecfbc1272 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:21.590125 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0e136225-6920-4ab8-b17a-84eecfbc1272 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:21.590940 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0e136225-6920-4ab8-b17a-84eecfbc1272 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:21.591430 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0e136225-6920-4ab8-b17a-84eecfbc1272 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:21.723599 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0e136225-6920-4ab8-b17a-84eecfbc1272 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:21.731701 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0e136225-6920-4ab8-b17a-84eecfbc1272 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:21.733247 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0e136225-6920-4ab8-b17a-84eecfbc1272 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:21.734966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0e136225-6920-4ab8-b17a-84eecfbc1272 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.156050 Jun 22 18:39:21.735515 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 133/263] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:21 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:21.824991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-de02bc1e-1a0f-440a-8f60-a4e0fbb3e960 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:21.825485 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-de02bc1e-1a0f-440a-8f60-a4e0fbb3e960 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:21.832376 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de02bc1e-1a0f-440a-8f60-a4e0fbb3e960 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:21.832905 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de02bc1e-1a0f-440a-8f60-a4e0fbb3e960 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:21.834280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de02bc1e-1a0f-440a-8f60-a4e0fbb3e960 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:21.834796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de02bc1e-1a0f-440a-8f60-a4e0fbb3e960 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:21.978285 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-de02bc1e-1a0f-440a-8f60-a4e0fbb3e960 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:21.987213 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-de02bc1e-1a0f-440a-8f60-a4e0fbb3e960 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.167169 Jun 22 18:39:21.987782 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 131/264] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:21 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:22.248032 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-252eee85-5560-454b-94d8-201fa753b135 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:22.248753 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-252eee85-5560-454b-94d8-201fa753b135 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:22.255115 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-252eee85-5560-454b-94d8-201fa753b135 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:22.255556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-252eee85-5560-454b-94d8-201fa753b135 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:22.256343 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-252eee85-5560-454b-94d8-201fa753b135 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:22.256771 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-252eee85-5560-454b-94d8-201fa753b135 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:22.261444 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c6d33080-8ec7-40c0-8324-85748f5aaf97 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:22.262352 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c6d33080-8ec7-40c0-8324-85748f5aaf97 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:22.269191 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c6d33080-8ec7-40c0-8324-85748f5aaf97 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:22.269720 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c6d33080-8ec7-40c0-8324-85748f5aaf97 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:22.270619 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c6d33080-8ec7-40c0-8324-85748f5aaf97 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:22.271153 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c6d33080-8ec7-40c0-8324-85748f5aaf97 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:22.325083 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-252eee85-5560-454b-94d8-201fa753b135 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:22.329910 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-252eee85-5560-454b-94d8-201fa753b135 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1209 microversion: 2.1 time: 0.085682 Jun 22 18:39:22.330481 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 134/265] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:22 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:22.405599 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c6d33080-8ec7-40c0-8324-85748f5aaf97 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:22.413018 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c6d33080-8ec7-40c0-8324-85748f5aaf97 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.155669 Jun 22 18:39:22.413586 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 132/266] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:22 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:22.469871 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-de48c315-72bc-4663-9b72-d1975e54b5db tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:22.470740 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-de48c315-72bc-4663-9b72-d1975e54b5db tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:22.476995 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-de48c315-72bc-4663-9b72-d1975e54b5db tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:22.477432 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-de48c315-72bc-4663-9b72-d1975e54b5db tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:22.478307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-de48c315-72bc-4663-9b72-d1975e54b5db tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:22.478668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-de48c315-72bc-4663-9b72-d1975e54b5db tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:22.617237 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-de48c315-72bc-4663-9b72-d1975e54b5db tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:22.625536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-de48c315-72bc-4663-9b72-d1975e54b5db tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.159626 Jun 22 18:39:22.626089 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 135/267] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:22 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:22.754231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-07b5fd1e-ff6f-4271-86ee-3f8af4c91dbf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:22.754828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-07b5fd1e-ff6f-4271-86ee-3f8af4c91dbf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:22.761123 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-07b5fd1e-ff6f-4271-86ee-3f8af4c91dbf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:22.761570 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-07b5fd1e-ff6f-4271-86ee-3f8af4c91dbf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:22.762325 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-07b5fd1e-ff6f-4271-86ee-3f8af4c91dbf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:22.762756 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-07b5fd1e-ff6f-4271-86ee-3f8af4c91dbf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:22.887325 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-07b5fd1e-ff6f-4271-86ee-3f8af4c91dbf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:22.895283 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-07b5fd1e-ff6f-4271-86ee-3f8af4c91dbf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:22.896823 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-07b5fd1e-ff6f-4271-86ee-3f8af4c91dbf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:22.897922 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-07b5fd1e-ff6f-4271-86ee-3f8af4c91dbf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.147743 Jun 22 18:39:22.898487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 133/268] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:22 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:23.003751 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f3f7bc82-afe6-4d28-9acf-6b91825994c1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:23.004392 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f3f7bc82-afe6-4d28-9acf-6b91825994c1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:23.010781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f3f7bc82-afe6-4d28-9acf-6b91825994c1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:23.011228 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f3f7bc82-afe6-4d28-9acf-6b91825994c1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:23.012013 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f3f7bc82-afe6-4d28-9acf-6b91825994c1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:23.012450 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f3f7bc82-afe6-4d28-9acf-6b91825994c1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:23.136497 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f3f7bc82-afe6-4d28-9acf-6b91825994c1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:23.140398 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=100 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:23.145339 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f3f7bc82-afe6-4d28-9acf-6b91825994c1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.145416 Jun 22 18:39:23.145894 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 136/269] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:22 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:23.347219 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-fa55e10c-5b59-4829-911e-63c4ef87b9be tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:23.347814 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-fa55e10c-5b59-4829-911e-63c4ef87b9be tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:23.353774 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fa55e10c-5b59-4829-911e-63c4ef87b9be tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:23.354216 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fa55e10c-5b59-4829-911e-63c4ef87b9be tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:23.354971 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fa55e10c-5b59-4829-911e-63c4ef87b9be tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:23.355396 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fa55e10c-5b59-4829-911e-63c4ef87b9be tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:23.414529 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-fa55e10c-5b59-4829-911e-63c4ef87b9be tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:23.421811 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-fa55e10c-5b59-4829-911e-63c4ef87b9be tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1209 microversion: 2.1 time: 0.079289 Jun 22 18:39:23.422363 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 134/270] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:23 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1209 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:23.429808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2351335f-0578-43f7-af4b-4ff1a4c0391c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:23.430481 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2351335f-0578-43f7-af4b-4ff1a4c0391c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:23.437133 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2351335f-0578-43f7-af4b-4ff1a4c0391c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:23.437647 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2351335f-0578-43f7-af4b-4ff1a4c0391c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:23.438399 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2351335f-0578-43f7-af4b-4ff1a4c0391c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:23.438823 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2351335f-0578-43f7-af4b-4ff1a4c0391c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:23.587704 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-2351335f-0578-43f7-af4b-4ff1a4c0391c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:23.595236 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2351335f-0578-43f7-af4b-4ff1a4c0391c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.169383 Jun 22 18:39:23.595788 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 137/271] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:23 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:23.643408 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-407f9a5a-6101-4303-bd5f-63670192198f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:23.644030 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-407f9a5a-6101-4303-bd5f-63670192198f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:23.649899 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-407f9a5a-6101-4303-bd5f-63670192198f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:23.650337 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-407f9a5a-6101-4303-bd5f-63670192198f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:23.651113 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-407f9a5a-6101-4303-bd5f-63670192198f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:23.651538 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-407f9a5a-6101-4303-bd5f-63670192198f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:23.788127 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-407f9a5a-6101-4303-bd5f-63670192198f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:23.795524 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-407f9a5a-6101-4303-bd5f-63670192198f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.157061 Jun 22 18:39:23.796195 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 135/272] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:23 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:23.916184 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ea8b069c-a41e-438f-94c2-0267dc026ee4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:23.916823 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ea8b069c-a41e-438f-94c2-0267dc026ee4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:23.923443 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ea8b069c-a41e-438f-94c2-0267dc026ee4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:23.923808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ea8b069c-a41e-438f-94c2-0267dc026ee4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:23.924597 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ea8b069c-a41e-438f-94c2-0267dc026ee4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:23.925017 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ea8b069c-a41e-438f-94c2-0267dc026ee4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:24.054763 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ea8b069c-a41e-438f-94c2-0267dc026ee4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:24.063358 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ea8b069c-a41e-438f-94c2-0267dc026ee4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:24.064899 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ea8b069c-a41e-438f-94c2-0267dc026ee4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:24.065973 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ea8b069c-a41e-438f-94c2-0267dc026ee4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.153693 Jun 22 18:39:24.066512 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 138/273] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:23 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:24.166796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-39807628-5678-43c1-9473-4f14e5a20054 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:24.167411 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-39807628-5678-43c1-9473-4f14e5a20054 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:24.176023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-39807628-5678-43c1-9473-4f14e5a20054 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:24.176382 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-39807628-5678-43c1-9473-4f14e5a20054 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:24.177177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-39807628-5678-43c1-9473-4f14e5a20054 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:24.177612 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-39807628-5678-43c1-9473-4f14e5a20054 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:24.319290 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-39807628-5678-43c1-9473-4f14e5a20054 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:24.326745 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-39807628-5678-43c1-9473-4f14e5a20054 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.163867 Jun 22 18:39:24.327360 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 136/274] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:24 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:24.438594 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-46422c13-2733-4580-a2df-cfc18d7d6edc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:24.439116 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-46422c13-2733-4580-a2df-cfc18d7d6edc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:24.440977 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:24.441622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=6 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:24.447775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46422c13-2733-4580-a2df-cfc18d7d6edc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:24.448240 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46422c13-2733-4580-a2df-cfc18d7d6edc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:24.448998 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46422c13-2733-4580-a2df-cfc18d7d6edc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:24.449424 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46422c13-2733-4580-a2df-cfc18d7d6edc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:24.509409 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-46422c13-2733-4580-a2df-cfc18d7d6edc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:24.517463 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-46422c13-2733-4580-a2df-cfc18d7d6edc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1209 microversion: 2.1 time: 0.082930 Jun 22 18:39:24.518098 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 139/275] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:24 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:24.612043 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1d065cff-33c0-4ac1-8064-a168573061d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:24.612641 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1d065cff-33c0-4ac1-8064-a168573061d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:24.614480 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:24.619747 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1d065cff-33c0-4ac1-8064-a168573061d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:24.620215 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1d065cff-33c0-4ac1-8064-a168573061d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:24.620970 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1d065cff-33c0-4ac1-8064-a168573061d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:24.621391 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1d065cff-33c0-4ac1-8064-a168573061d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:24.752852 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1d065cff-33c0-4ac1-8064-a168573061d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:24.761000 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1d065cff-33c0-4ac1-8064-a168573061d5 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.153032 Jun 22 18:39:24.761565 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 137/276] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:24 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:24.812185 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-dabf5770-b0b8-49cc-903b-9cd4ee4f97c3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:24.813061 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-dabf5770-b0b8-49cc-903b-9cd4ee4f97c3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:24.819312 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dabf5770-b0b8-49cc-903b-9cd4ee4f97c3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:24.819749 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dabf5770-b0b8-49cc-903b-9cd4ee4f97c3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:24.820531 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dabf5770-b0b8-49cc-903b-9cd4ee4f97c3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:24.820952 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dabf5770-b0b8-49cc-903b-9cd4ee4f97c3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:24.950717 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dabf5770-b0b8-49cc-903b-9cd4ee4f97c3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:24.958726 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-dabf5770-b0b8-49cc-903b-9cd4ee4f97c3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.150339 Jun 22 18:39:24.959290 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 140/277] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:24 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:25.084692 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bde424c3-239b-4a0f-8cd0-254b2e333c8c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:25.085409 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bde424c3-239b-4a0f-8cd0-254b2e333c8c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:25.091760 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bde424c3-239b-4a0f-8cd0-254b2e333c8c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:25.092260 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bde424c3-239b-4a0f-8cd0-254b2e333c8c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:25.093285 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bde424c3-239b-4a0f-8cd0-254b2e333c8c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:25.093451 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bde424c3-239b-4a0f-8cd0-254b2e333c8c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:25.223105 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bde424c3-239b-4a0f-8cd0-254b2e333c8c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:25.231245 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bde424c3-239b-4a0f-8cd0-254b2e333c8c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:25.232854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bde424c3-239b-4a0f-8cd0-254b2e333c8c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:25.233943 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bde424c3-239b-4a0f-8cd0-254b2e333c8c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.153285 Jun 22 18:39:25.235115 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 138/278] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:25 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:25.342124 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0e2882cd-903e-4685-b648-d687b5006e2b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:25.342733 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0e2882cd-903e-4685-b648-d687b5006e2b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:25.349789 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0e2882cd-903e-4685-b648-d687b5006e2b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:25.350245 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0e2882cd-903e-4685-b648-d687b5006e2b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:25.351016 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0e2882cd-903e-4685-b648-d687b5006e2b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:25.351448 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0e2882cd-903e-4685-b648-d687b5006e2b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:25.484623 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0e2882cd-903e-4685-b648-d687b5006e2b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:25.492748 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0e2882cd-903e-4685-b648-d687b5006e2b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.154394 Jun 22 18:39:25.493500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 141/279] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:25 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:25.535920 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-44c2473d-113e-494c-8c34-1f6d56de016a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:25.536519 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-44c2473d-113e-494c-8c34-1f6d56de016a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:25.542415 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-44c2473d-113e-494c-8c34-1f6d56de016a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:25.542850 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-44c2473d-113e-494c-8c34-1f6d56de016a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:25.543599 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-44c2473d-113e-494c-8c34-1f6d56de016a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:25.544061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-44c2473d-113e-494c-8c34-1f6d56de016a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:25.605219 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-44c2473d-113e-494c-8c34-1f6d56de016a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:25.613529 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-44c2473d-113e-494c-8c34-1f6d56de016a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1209 microversion: 2.1 time: 0.081983 Jun 22 18:39:25.614115 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 139/280] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:25 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:25.777917 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-715c7db6-1267-4f35-9c73-85399fd409c9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:25.778513 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-715c7db6-1267-4f35-9c73-85399fd409c9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:25.785244 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-715c7db6-1267-4f35-9c73-85399fd409c9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:25.785705 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-715c7db6-1267-4f35-9c73-85399fd409c9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:25.786462 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-715c7db6-1267-4f35-9c73-85399fd409c9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:25.786887 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-715c7db6-1267-4f35-9c73-85399fd409c9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:25.931128 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-715c7db6-1267-4f35-9c73-85399fd409c9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:25.940043 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-715c7db6-1267-4f35-9c73-85399fd409c9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1315 microversion: 2.1 time: 0.166103 Jun 22 18:39:25.940825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 142/281] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:25 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:25.976341 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6137b51e-cf4c-4b1f-a4a1-d46eac4da50b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:25.977015 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6137b51e-cf4c-4b1f-a4a1-d46eac4da50b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:25.983303 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6137b51e-cf4c-4b1f-a4a1-d46eac4da50b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:25.983744 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6137b51e-cf4c-4b1f-a4a1-d46eac4da50b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:25.984812 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6137b51e-cf4c-4b1f-a4a1-d46eac4da50b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:25.985260 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6137b51e-cf4c-4b1f-a4a1-d46eac4da50b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:26.151042 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6137b51e-cf4c-4b1f-a4a1-d46eac4da50b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:26.159373 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6137b51e-cf4c-4b1f-a4a1-d46eac4da50b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.187623 Jun 22 18:39:26.160275 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 140/282] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:25 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:26.253530 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d3c4200e-7878-4905-a7a2-0bfbedab9782 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:26.254157 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d3c4200e-7878-4905-a7a2-0bfbedab9782 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:26.260523 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d3c4200e-7878-4905-a7a2-0bfbedab9782 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:26.260975 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d3c4200e-7878-4905-a7a2-0bfbedab9782 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:26.261734 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d3c4200e-7878-4905-a7a2-0bfbedab9782 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:26.262165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d3c4200e-7878-4905-a7a2-0bfbedab9782 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:26.400937 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d3c4200e-7878-4905-a7a2-0bfbedab9782 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:26.409966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d3c4200e-7878-4905-a7a2-0bfbedab9782 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:26.411462 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d3c4200e-7878-4905-a7a2-0bfbedab9782 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:26.412579 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d3c4200e-7878-4905-a7a2-0bfbedab9782 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.164133 Jun 22 18:39:26.413139 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 143/283] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:26 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:39:26.509744 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-34eb99cd-1197-4361-b52e-ef7e8b49f9ab tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:26.510273 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-34eb99cd-1197-4361-b52e-ef7e8b49f9ab tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:26.517750 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-34eb99cd-1197-4361-b52e-ef7e8b49f9ab tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:26.518197 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-34eb99cd-1197-4361-b52e-ef7e8b49f9ab tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:26.518968 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-34eb99cd-1197-4361-b52e-ef7e8b49f9ab tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:26.519400 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-34eb99cd-1197-4361-b52e-ef7e8b49f9ab tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:26.630003 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4d666b9c-3142-4aee-bf15-48acaa2f51fc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:26.631241 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4d666b9c-3142-4aee-bf15-48acaa2f51fc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:26.642758 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4d666b9c-3142-4aee-bf15-48acaa2f51fc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:26.643369 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4d666b9c-3142-4aee-bf15-48acaa2f51fc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:26.644305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4d666b9c-3142-4aee-bf15-48acaa2f51fc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:26.644969 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4d666b9c-3142-4aee-bf15-48acaa2f51fc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:26.722497 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4d666b9c-3142-4aee-bf15-48acaa2f51fc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:26.732909 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4d666b9c-3142-4aee-bf15-48acaa2f51fc tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1209 microversion: 2.1 time: 0.106730 Jun 22 18:39:26.744794 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 144/284] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:26 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:26.959750 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-56a7c886-ac41-47ba-b44d-1dcb63dd52a0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:26.960535 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-56a7c886-ac41-47ba-b44d-1dcb63dd52a0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:26.967902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-56a7c886-ac41-47ba-b44d-1dcb63dd52a0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:26.969512 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-56a7c886-ac41-47ba-b44d-1dcb63dd52a0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:26.970476 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-56a7c886-ac41-47ba-b44d-1dcb63dd52a0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:26.970911 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-56a7c886-ac41-47ba-b44d-1dcb63dd52a0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:27.001316 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-34eb99cd-1197-4361-b52e-ef7e8b49f9ab tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:27.022832 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-34eb99cd-1197-4361-b52e-ef7e8b49f9ab tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.517121 Jun 22 18:39:27.023569 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 141/285] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:26 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:27.131511 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-56a7c886-ac41-47ba-b44d-1dcb63dd52a0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:27.140013 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-56a7c886-ac41-47ba-b44d-1dcb63dd52a0 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1501 microversion: 2.1 time: 0.185223 Jun 22 18:39:27.152888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 145/286] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:26 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1501 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:27.181426 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6edc4062-8077-4794-a64d-af35b85f3ef1 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:27.182288 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6edc4062-8077-4794-a64d-af35b85f3ef1 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:27.191721 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6edc4062-8077-4794-a64d-af35b85f3ef1 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:27.201892 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6edc4062-8077-4794-a64d-af35b85f3ef1 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:27.202899 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6edc4062-8077-4794-a64d-af35b85f3ef1 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:27.204760 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6edc4062-8077-4794-a64d-af35b85f3ef1 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:27.397351 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6edc4062-8077-4794-a64d-af35b85f3ef1 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:27.406670 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6edc4062-8077-4794-a64d-af35b85f3ef1 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.228254 Jun 22 18:39:27.416830 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 142/287] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:27 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:27.432021 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1362a80f-cded-4192-8d8e-42a3e01f833a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:27.432624 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-1362a80f-cded-4192-8d8e-42a3e01f833a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:27.439151 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1362a80f-cded-4192-8d8e-42a3e01f833a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:27.439609 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1362a80f-cded-4192-8d8e-42a3e01f833a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:27.440814 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1362a80f-cded-4192-8d8e-42a3e01f833a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:27.441391 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1362a80f-cded-4192-8d8e-42a3e01f833a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:27.668604 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-1362a80f-cded-4192-8d8e-42a3e01f833a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:27.681965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-1362a80f-cded-4192-8d8e-42a3e01f833a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:27.683851 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-1362a80f-cded-4192-8d8e-42a3e01f833a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:27.685158 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-1362a80f-cded-4192-8d8e-42a3e01f833a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.257749 Jun 22 18:39:27.686201 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 146/288] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:27 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:39:27.753660 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1f67285a-37d8-4260-a8cc-b685fa2b1be3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:27.754288 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1f67285a-37d8-4260-a8cc-b685fa2b1be3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:27.765073 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f67285a-37d8-4260-a8cc-b685fa2b1be3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:27.766542 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f67285a-37d8-4260-a8cc-b685fa2b1be3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:27.767507 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f67285a-37d8-4260-a8cc-b685fa2b1be3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:27.768333 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f67285a-37d8-4260-a8cc-b685fa2b1be3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:27.852756 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1f67285a-37d8-4260-a8cc-b685fa2b1be3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:27.861717 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1f67285a-37d8-4260-a8cc-b685fa2b1be3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1265 microversion: 2.1 time: 0.115010 Jun 22 18:39:27.862300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 143/289] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:27 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:28.040514 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4555ada6-5cd7-412b-94d4-e46b75e615b2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:28.041120 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4555ada6-5cd7-412b-94d4-e46b75e615b2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:28.048050 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4555ada6-5cd7-412b-94d4-e46b75e615b2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:28.048453 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4555ada6-5cd7-412b-94d4-e46b75e615b2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:28.049232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4555ada6-5cd7-412b-94d4-e46b75e615b2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:28.049666 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4555ada6-5cd7-412b-94d4-e46b75e615b2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:28.204543 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4555ada6-5cd7-412b-94d4-e46b75e615b2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:28.213239 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4555ada6-5cd7-412b-94d4-e46b75e615b2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1322 microversion: 2.1 time: 0.176418 Jun 22 18:39:28.214001 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 147/290] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:28 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:28.422776 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1d225756-e377-4982-8b19-c5358402e43b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:28.423399 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1d225756-e377-4982-8b19-c5358402e43b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:28.429441 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1d225756-e377-4982-8b19-c5358402e43b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:28.429883 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1d225756-e377-4982-8b19-c5358402e43b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:28.430863 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1d225756-e377-4982-8b19-c5358402e43b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:28.431298 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1d225756-e377-4982-8b19-c5358402e43b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:28.579726 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1d225756-e377-4982-8b19-c5358402e43b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:28.587188 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1d225756-e377-4982-8b19-c5358402e43b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.168663 Jun 22 18:39:28.587749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 144/291] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:28 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:28.705311 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9cc90b3c-12d6-4c01-9c95-746c7963666b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:28.706622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9cc90b3c-12d6-4c01-9c95-746c7963666b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:28.712332 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f1c8ddf4-e2a2-4671-8df0-4156abbcaae7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55bddc25-ed23-47fe-902e-a30659affcad"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:39:28.713457 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f1c8ddf4-e2a2-4671-8df0-4156abbcaae7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:28.713561 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9cc90b3c-12d6-4c01-9c95-746c7963666b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:28.713935 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9cc90b3c-12d6-4c01-9c95-746c7963666b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:28.714709 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9cc90b3c-12d6-4c01-9c95-746c7963666b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:28.715149 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9cc90b3c-12d6-4c01-9c95-746c7963666b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:28.720759 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f1c8ddf4-e2a2-4671-8df0-4156abbcaae7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:28.721519 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f1c8ddf4-e2a2-4671-8df0-4156abbcaae7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:28.722291 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f1c8ddf4-e2a2-4671-8df0-4156abbcaae7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:28.722723 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f1c8ddf4-e2a2-4671-8df0-4156abbcaae7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:28.884831 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9cc90b3c-12d6-4c01-9c95-746c7963666b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:28.905001 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9cc90b3c-12d6-4c01-9c95-746c7963666b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:28.907234 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9cc90b3c-12d6-4c01-9c95-746c7963666b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:28.908415 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9cc90b3c-12d6-4c01-9c95-746c7963666b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.207695 Jun 22 18:39:28.914443 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 148/292] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:28 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:28.923695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-fe5c9dee-faef-49d1-bc05-3048ceb3177b tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:28.924856 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-fe5c9dee-faef-49d1-bc05-3048ceb3177b tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:28.930972 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fe5c9dee-faef-49d1-bc05-3048ceb3177b tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:28.931410 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fe5c9dee-faef-49d1-bc05-3048ceb3177b tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:28.932191 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fe5c9dee-faef-49d1-bc05-3048ceb3177b tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:28.932773 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fe5c9dee-faef-49d1-bc05-3048ceb3177b tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:29.003530 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fe5c9dee-faef-49d1-bc05-3048ceb3177b tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:29.011497 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-fe5c9dee-faef-49d1-bc05-3048ceb3177b tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1283 microversion: 2.1 time: 0.094986 Jun 22 18:39:29.012082 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 149/293] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:28 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1283 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:29.230555 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7c277c24-f018-4dca-80c7-4b1dfc050fc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:29.231390 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7c277c24-f018-4dca-80c7-4b1dfc050fc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:29.244757 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7c277c24-f018-4dca-80c7-4b1dfc050fc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:29.247233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7c277c24-f018-4dca-80c7-4b1dfc050fc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:29.248374 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7c277c24-f018-4dca-80c7-4b1dfc050fc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:29.251248 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7c277c24-f018-4dca-80c7-4b1dfc050fc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:29.576174 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7c277c24-f018-4dca-80c7-4b1dfc050fc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:29.597736 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7c277c24-f018-4dca-80c7-4b1dfc050fc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1515 microversion: 2.1 time: 0.370954 Jun 22 18:39:29.621897 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 150/294] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:29 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1515 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:29.628707 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-eb4e617d-84b2-4d30-9c60-13f64754770d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:29.629736 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-eb4e617d-84b2-4d30-9c60-13f64754770d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:29.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eb4e617d-84b2-4d30-9c60-13f64754770d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:29.637721 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eb4e617d-84b2-4d30-9c60-13f64754770d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:29.638826 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eb4e617d-84b2-4d30-9c60-13f64754770d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:29.639406 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eb4e617d-84b2-4d30-9c60-13f64754770d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:29.798608 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-eb4e617d-84b2-4d30-9c60-13f64754770d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:29.806260 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-eb4e617d-84b2-4d30-9c60-13f64754770d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.183223 Jun 22 18:39:29.806820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 151/295] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:29 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:29.811909 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6003bb33-9848-4e04-920d-49294ae6f110 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:39:29.813222 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6003bb33-9848-4e04-920d-49294ae6f110 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:29.819742 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6003bb33-9848-4e04-920d-49294ae6f110 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:29.820227 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6003bb33-9848-4e04-920d-49294ae6f110 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:29.821239 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6003bb33-9848-4e04-920d-49294ae6f110 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:29.821863 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6003bb33-9848-4e04-920d-49294ae6f110 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:29.893670 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-6003bb33-9848-4e04-920d-49294ae6f110 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lazy-loading 'flavor' on Instance uuid 5414be47-8679-4c15-9b75-4da9d4d9ac1b {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:39:29.970626 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:30.037404 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6003bb33-9848-4e04-920d-49294ae6f110 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "POST /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b/action" status: 200 len: 32 microversion: 2.1 time: 0.229078 Jun 22 18:39:30.038006 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 152/296] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:39:29 2022] POST /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 18:39:30.043321 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-78b11d26-38f0-48b5-b2a3-f04ef6298cfd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:30.044062 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-78b11d26-38f0-48b5-b2a3-f04ef6298cfd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:30.052101 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-78b11d26-38f0-48b5-b2a3-f04ef6298cfd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:30.052574 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-78b11d26-38f0-48b5-b2a3-f04ef6298cfd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:30.053313 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-78b11d26-38f0-48b5-b2a3-f04ef6298cfd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:30.053738 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-78b11d26-38f0-48b5-b2a3-f04ef6298cfd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:30.203503 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-78b11d26-38f0-48b5-b2a3-f04ef6298cfd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:30.213085 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-78b11d26-38f0-48b5-b2a3-f04ef6298cfd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:30.214721 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-78b11d26-38f0-48b5-b2a3-f04ef6298cfd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:30.215814 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-78b11d26-38f0-48b5-b2a3-f04ef6298cfd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.176759 Jun 22 18:39:30.216536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 153/297] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:30 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:30.221980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a583bfa7-380f-4fb1-ad72-fa7e57e4ba76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:30.222573 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a583bfa7-380f-4fb1-ad72-fa7e57e4ba76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:30.228545 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a583bfa7-380f-4fb1-ad72-fa7e57e4ba76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:30.229197 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a583bfa7-380f-4fb1-ad72-fa7e57e4ba76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:30.229950 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a583bfa7-380f-4fb1-ad72-fa7e57e4ba76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:30.230373 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a583bfa7-380f-4fb1-ad72-fa7e57e4ba76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:30.414417 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a583bfa7-380f-4fb1-ad72-fa7e57e4ba76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:30.427244 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a583bfa7-380f-4fb1-ad72-fa7e57e4ba76 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.209446 Jun 22 18:39:30.428345 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 154/298] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:30 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:30.433051 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-04ee7968-7c58-438f-a47e-664f5ac31a16 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:30.433641 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-04ee7968-7c58-438f-a47e-664f5ac31a16 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:30.439823 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-04ee7968-7c58-438f-a47e-664f5ac31a16 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:30.440324 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-04ee7968-7c58-438f-a47e-664f5ac31a16 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:30.441087 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-04ee7968-7c58-438f-a47e-664f5ac31a16 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:30.441523 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-04ee7968-7c58-438f-a47e-664f5ac31a16 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:30.592011 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f1c8ddf4-e2a2-4671-8df0-4156abbcaae7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "POST /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.883308 Jun 22 18:39:30.594660 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 145/299] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:39:28 2022] POST /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f/os-volume_attachments => generated 194 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:39:30.666618 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-04ee7968-7c58-438f-a47e-664f5ac31a16 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:30.682460 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-04ee7968-7c58-438f-a47e-664f5ac31a16 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.252529 Jun 22 18:39:30.683186 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 155/300] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:30 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:30.778175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-eda4c2d5-b849-437a-a108-954d1dab2433 req-98dbebe0-6947-4701-9e95-af34b8852bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688c6da6-d454-4dc0-8335-b0a4e16f5824", "name": "network-vif-plugged", "status": "completed", "tag": "24070ee1-9191-4d52-8234-91ae16aa72a0"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:39:30.793617 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-eda4c2d5-b849-437a-a108-954d1dab2433 req-98dbebe0-6947-4701-9e95-af34b8852bb4 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:30.794312 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-eda4c2d5-b849-437a-a108-954d1dab2433 req-98dbebe0-6947-4701-9e95-af34b8852bb4 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:30.806939 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:30.810104 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-eda4c2d5-b849-437a-a108-954d1dab2433 req-98dbebe0-6947-4701-9e95-af34b8852bb4 service nova] Creating event network-vif-plugged:24070ee1-9191-4d52-8234-91ae16aa72a0 for instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 on hv-cinder-81268 Jun 22 18:39:30.820664 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-eda4c2d5-b849-437a-a108-954d1dab2433 req-98dbebe0-6947-4701-9e95-af34b8852bb4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046750 Jun 22 18:39:30.822113 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 146/301] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:39:30.836509 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5050d141-fa63-4fca-97ef-403e3be43dc4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:30.836509 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5050d141-fa63-4fca-97ef-403e3be43dc4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:30.850443 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5050d141-fa63-4fca-97ef-403e3be43dc4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:30.850911 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5050d141-fa63-4fca-97ef-403e3be43dc4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:30.851688 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5050d141-fa63-4fca-97ef-403e3be43dc4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:30.852165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5050d141-fa63-4fca-97ef-403e3be43dc4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:31.098572 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5050d141-fa63-4fca-97ef-403e3be43dc4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:31.107302 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5050d141-fa63-4fca-97ef-403e3be43dc4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1362 microversion: 2.1 time: 0.286800 Jun 22 18:39:31.107947 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 156/302] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:30 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:31.243605 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5015d5ab-75e3-4f19-8501-2a8f5f2f8c4e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:31.245963 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5015d5ab-75e3-4f19-8501-2a8f5f2f8c4e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:31.264478 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5015d5ab-75e3-4f19-8501-2a8f5f2f8c4e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:31.264927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5015d5ab-75e3-4f19-8501-2a8f5f2f8c4e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:31.266322 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5015d5ab-75e3-4f19-8501-2a8f5f2f8c4e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:31.266853 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5015d5ab-75e3-4f19-8501-2a8f5f2f8c4e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:31.444611 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6929a5b5-276c-4177-a547-b634939ed114 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:31.445605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6929a5b5-276c-4177-a547-b634939ed114 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:31.457474 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6929a5b5-276c-4177-a547-b634939ed114 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:31.458155 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6929a5b5-276c-4177-a547-b634939ed114 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:31.459120 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6929a5b5-276c-4177-a547-b634939ed114 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:31.459727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6929a5b5-276c-4177-a547-b634939ed114 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:31.503691 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5015d5ab-75e3-4f19-8501-2a8f5f2f8c4e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:31.512597 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5015d5ab-75e3-4f19-8501-2a8f5f2f8c4e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:31.514372 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5015d5ab-75e3-4f19-8501-2a8f5f2f8c4e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:31.516820 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5015d5ab-75e3-4f19-8501-2a8f5f2f8c4e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.285978 Jun 22 18:39:31.517887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 147/303] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:31 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:31.522357 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-7ef45e4b-ebbf-4263-ad64-db601f0176cc req-bb5fdfa0-0527-4d51-9f0c-461691491908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10bda053-aa92-4811-ae79-e5ed926c5860", "tag": "a0636fe7-12f6-4d9e-8831-3d1efe728a6c"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:39:31.531364 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-7ef45e4b-ebbf-4263-ad64-db601f0176cc req-bb5fdfa0-0527-4d51-9f0c-461691491908 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:31.537395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-7ef45e4b-ebbf-4263-ad64-db601f0176cc req-bb5fdfa0-0527-4d51-9f0c-461691491908 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:31.549574 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-7ef45e4b-ebbf-4263-ad64-db601f0176cc req-bb5fdfa0-0527-4d51-9f0c-461691491908 service nova] Creating event network-changed:a0636fe7-12f6-4d9e-8831-3d1efe728a6c for instance 10bda053-aa92-4811-ae79-e5ed926c5860 on hv-cinder-81268 Jun 22 18:39:31.554209 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-7ef45e4b-ebbf-4263-ad64-db601f0176cc req-bb5fdfa0-0527-4d51-9f0c-461691491908 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035060 Jun 22 18:39:31.554807 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 148/304] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:39:31.605639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6929a5b5-276c-4177-a547-b634939ed114 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:31.613573 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6929a5b5-276c-4177-a547-b634939ed114 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.172928 Jun 22 18:39:31.614145 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 157/305] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:31 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:31.700554 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7e1394e5-ba2a-4ab9-aeb0-aff5574918e1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:31.701252 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7e1394e5-ba2a-4ab9-aeb0-aff5574918e1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:31.708431 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7e1394e5-ba2a-4ab9-aeb0-aff5574918e1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:31.708911 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7e1394e5-ba2a-4ab9-aeb0-aff5574918e1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:31.709847 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7e1394e5-ba2a-4ab9-aeb0-aff5574918e1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:31.710523 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7e1394e5-ba2a-4ab9-aeb0-aff5574918e1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:31.848686 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7e1394e5-ba2a-4ab9-aeb0-aff5574918e1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:31.856080 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7e1394e5-ba2a-4ab9-aeb0-aff5574918e1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.160909 Jun 22 18:39:31.856852 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 149/306] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:31 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:32.125299 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d2322940-a641-41a8-9d86-337fd2c89400 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:32.126308 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d2322940-a641-41a8-9d86-337fd2c89400 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:32.133994 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d2322940-a641-41a8-9d86-337fd2c89400 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:32.134386 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d2322940-a641-41a8-9d86-337fd2c89400 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:32.135274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d2322940-a641-41a8-9d86-337fd2c89400 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:32.135733 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d2322940-a641-41a8-9d86-337fd2c89400 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:32.535102 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-cd252575-06ea-49e9-bde6-5ee7f691212d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:32.535710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-cd252575-06ea-49e9-bde6-5ee7f691212d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:32.541922 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cd252575-06ea-49e9-bde6-5ee7f691212d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:32.542368 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cd252575-06ea-49e9-bde6-5ee7f691212d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:32.543135 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cd252575-06ea-49e9-bde6-5ee7f691212d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:32.543566 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cd252575-06ea-49e9-bde6-5ee7f691212d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:32.593127 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d2322940-a641-41a8-9d86-337fd2c89400 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:32.600768 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d2322940-a641-41a8-9d86-337fd2c89400 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1548 microversion: 2.1 time: 0.480250 Jun 22 18:39:32.601562 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 158/307] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:32 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1548 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:32.617434 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8ae3f09b-9ff4-4515-823c-0e5edf204115 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:32.617920 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8ae3f09b-9ff4-4515-823c-0e5edf204115 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:32.623872 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8ae3f09b-9ff4-4515-823c-0e5edf204115 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:32.624553 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8ae3f09b-9ff4-4515-823c-0e5edf204115 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:32.625948 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8ae3f09b-9ff4-4515-823c-0e5edf204115 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:32.626579 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8ae3f09b-9ff4-4515-823c-0e5edf204115 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:32.673585 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cd252575-06ea-49e9-bde6-5ee7f691212d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:32.681881 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cd252575-06ea-49e9-bde6-5ee7f691212d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:32.683385 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cd252575-06ea-49e9-bde6-5ee7f691212d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:32.684507 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-cd252575-06ea-49e9-bde6-5ee7f691212d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.153710 Jun 22 18:39:32.685104 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 150/308] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:32 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:39:32.690280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4accc792-442f-4c69-b96c-2c99c33e19a1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:32.690887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-4accc792-442f-4c69-b96c-2c99c33e19a1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:32.697712 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4accc792-442f-4c69-b96c-2c99c33e19a1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:32.698393 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4accc792-442f-4c69-b96c-2c99c33e19a1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:32.699451 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4accc792-442f-4c69-b96c-2c99c33e19a1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:32.700200 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4accc792-442f-4c69-b96c-2c99c33e19a1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:32.703129 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8ae3f09b-9ff4-4515-823c-0e5edf204115 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089339 Jun 22 18:39:32.703778 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 159/309] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 18:39:32 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:39:32.874433 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3fba0e79-8a75-4ad2-90d5-9ebe0d6daa46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:32.875183 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3fba0e79-8a75-4ad2-90d5-9ebe0d6daa46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:32.881329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3fba0e79-8a75-4ad2-90d5-9ebe0d6daa46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:32.881778 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3fba0e79-8a75-4ad2-90d5-9ebe0d6daa46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:32.882799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3fba0e79-8a75-4ad2-90d5-9ebe0d6daa46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:32.883929 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3fba0e79-8a75-4ad2-90d5-9ebe0d6daa46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:32.988928 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4accc792-442f-4c69-b96c-2c99c33e19a1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:32.998014 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4accc792-442f-4c69-b96c-2c99c33e19a1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.311861 Jun 22 18:39:32.998592 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 151/310] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:32 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:33.024519 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3fba0e79-8a75-4ad2-90d5-9ebe0d6daa46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:33.032388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3fba0e79-8a75-4ad2-90d5-9ebe0d6daa46 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.161761 Jun 22 18:39:33.032951 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 160/311] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:32 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:33.707308 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-37ef0f33-dc1a-4511-a8d7-9b469da3930c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:33.708151 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-37ef0f33-dc1a-4511-a8d7-9b469da3930c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:33.716152 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-37ef0f33-dc1a-4511-a8d7-9b469da3930c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:33.716783 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-37ef0f33-dc1a-4511-a8d7-9b469da3930c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:33.718020 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-37ef0f33-dc1a-4511-a8d7-9b469da3930c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:33.718762 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-37ef0f33-dc1a-4511-a8d7-9b469da3930c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:33.966946 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-37ef0f33-dc1a-4511-a8d7-9b469da3930c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:33.975359 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-37ef0f33-dc1a-4511-a8d7-9b469da3930c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:33.976880 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-37ef0f33-dc1a-4511-a8d7-9b469da3930c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:33.977959 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-37ef0f33-dc1a-4511-a8d7-9b469da3930c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.274719 Jun 22 18:39:33.978505 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 152/312] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:33 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:34.016159 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2a131fd8-10bd-405a-9b8b-ace140244482 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:34.016772 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2a131fd8-10bd-405a-9b8b-ace140244482 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:34.022700 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2a131fd8-10bd-405a-9b8b-ace140244482 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:34.023142 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2a131fd8-10bd-405a-9b8b-ace140244482 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:34.023927 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2a131fd8-10bd-405a-9b8b-ace140244482 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:34.024354 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2a131fd8-10bd-405a-9b8b-ace140244482 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:34.049912 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-9f93a663-69d5-4f67-8362-a1e04a0e2d9c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:34.050625 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-9f93a663-69d5-4f67-8362-a1e04a0e2d9c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:34.056978 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9f93a663-69d5-4f67-8362-a1e04a0e2d9c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:34.057435 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9f93a663-69d5-4f67-8362-a1e04a0e2d9c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:34.058205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9f93a663-69d5-4f67-8362-a1e04a0e2d9c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:34.058642 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9f93a663-69d5-4f67-8362-a1e04a0e2d9c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:34.156698 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-2a131fd8-10bd-405a-9b8b-ace140244482 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:34.164587 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2a131fd8-10bd-405a-9b8b-ace140244482 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.152240 Jun 22 18:39:34.165154 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 161/313] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:34 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:34.305135 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-9f93a663-69d5-4f67-8362-a1e04a0e2d9c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:34.315341 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-9f93a663-69d5-4f67-8362-a1e04a0e2d9c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.267778 Jun 22 18:39:34.315341 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 153/314] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:34 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:34.324111 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-ee10b7b4-92d8-4d23-b331-30245a7ea7fc req-1d12f011-3eda-495e-bcad-7ae2e7e5ecf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a9799ba-7e8d-4145-b942-752d45813cfc", "tag": "ff5e1751-3636-44a9-8f6a-879586f4b3a2"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:39:34.333111 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-ee10b7b4-92d8-4d23-b331-30245a7ea7fc req-1d12f011-3eda-495e-bcad-7ae2e7e5ecf1 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:34.333542 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-ee10b7b4-92d8-4d23-b331-30245a7ea7fc req-1d12f011-3eda-495e-bcad-7ae2e7e5ecf1 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:34.344420 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-ee10b7b4-92d8-4d23-b331-30245a7ea7fc req-1d12f011-3eda-495e-bcad-7ae2e7e5ecf1 service nova] Creating event network-changed:ff5e1751-3636-44a9-8f6a-879586f4b3a2 for instance 2a9799ba-7e8d-4145-b942-752d45813cfc on hv-cinder-81268 Jun 22 18:39:34.349421 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-ee10b7b4-92d8-4d23-b331-30245a7ea7fc req-1d12f011-3eda-495e-bcad-7ae2e7e5ecf1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028878 Jun 22 18:39:34.349983 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 162/315] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:39:34.995921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ff439249-7ad0-4cdf-86a0-87838630c38f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:34.996521 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ff439249-7ad0-4cdf-86a0-87838630c38f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:35.003558 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ff439249-7ad0-4cdf-86a0-87838630c38f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:35.004041 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ff439249-7ad0-4cdf-86a0-87838630c38f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:35.004848 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ff439249-7ad0-4cdf-86a0-87838630c38f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:35.005302 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ff439249-7ad0-4cdf-86a0-87838630c38f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:35.149576 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ff439249-7ad0-4cdf-86a0-87838630c38f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:35.158179 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ff439249-7ad0-4cdf-86a0-87838630c38f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:35.159764 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ff439249-7ad0-4cdf-86a0-87838630c38f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:35.160924 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ff439249-7ad0-4cdf-86a0-87838630c38f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.168920 Jun 22 18:39:35.161480 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 154/316] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:34 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:35.182802 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a20ae147-2fd3-4c93-ab0e-b78d65b0a412 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:35.185887 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a20ae147-2fd3-4c93-ab0e-b78d65b0a412 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:35.194235 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a20ae147-2fd3-4c93-ab0e-b78d65b0a412 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:35.194681 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a20ae147-2fd3-4c93-ab0e-b78d65b0a412 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:35.195617 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a20ae147-2fd3-4c93-ab0e-b78d65b0a412 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:35.196135 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a20ae147-2fd3-4c93-ab0e-b78d65b0a412 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:35.331395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b5d5735c-3fd2-4966-82ce-3db647856e10 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:35.332399 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b5d5735c-3fd2-4966-82ce-3db647856e10 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:35.345898 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b5d5735c-3fd2-4966-82ce-3db647856e10 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:35.346719 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b5d5735c-3fd2-4966-82ce-3db647856e10 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:35.347754 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b5d5735c-3fd2-4966-82ce-3db647856e10 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:35.349423 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b5d5735c-3fd2-4966-82ce-3db647856e10 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:35.353507 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a20ae147-2fd3-4c93-ab0e-b78d65b0a412 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:35.367220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a20ae147-2fd3-4c93-ab0e-b78d65b0a412 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.188177 Jun 22 18:39:35.368183 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 163/317] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:35 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:35.809746 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b5d5735c-3fd2-4966-82ce-3db647856e10 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:35.819022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b5d5735c-3fd2-4966-82ce-3db647856e10 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.492353 Jun 22 18:39:35.820054 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 155/318] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:35 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:36.180603 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7333c824-a7c9-41cc-8885-0aa1cb6e602f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:36.181311 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7333c824-a7c9-41cc-8885-0aa1cb6e602f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:36.190628 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7333c824-a7c9-41cc-8885-0aa1cb6e602f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:36.190628 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7333c824-a7c9-41cc-8885-0aa1cb6e602f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:36.191399 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7333c824-a7c9-41cc-8885-0aa1cb6e602f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:36.191948 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7333c824-a7c9-41cc-8885-0aa1cb6e602f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:36.355388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7333c824-a7c9-41cc-8885-0aa1cb6e602f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:36.367284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7333c824-a7c9-41cc-8885-0aa1cb6e602f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:36.368869 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7333c824-a7c9-41cc-8885-0aa1cb6e602f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:36.371489 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7333c824-a7c9-41cc-8885-0aa1cb6e602f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.194367 Jun 22 18:39:36.372078 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 164/319] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:36 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:36.386225 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-da7d7bd9-87d7-400e-8d0c-9040559e87ae tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:36.386870 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-da7d7bd9-87d7-400e-8d0c-9040559e87ae tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:36.395513 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-da7d7bd9-87d7-400e-8d0c-9040559e87ae tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:36.395991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-da7d7bd9-87d7-400e-8d0c-9040559e87ae tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:36.396947 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-da7d7bd9-87d7-400e-8d0c-9040559e87ae tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:36.397378 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-da7d7bd9-87d7-400e-8d0c-9040559e87ae tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:36.709085 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-da7d7bd9-87d7-400e-8d0c-9040559e87ae tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:36.716623 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-da7d7bd9-87d7-400e-8d0c-9040559e87ae tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.335736 Jun 22 18:39:36.717189 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 156/320] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:36 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:36.835781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-bb48d6b3-7852-402c-8b4b-0bcd932688f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:36.836626 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-bb48d6b3-7852-402c-8b4b-0bcd932688f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:36.842782 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bb48d6b3-7852-402c-8b4b-0bcd932688f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:36.843820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bb48d6b3-7852-402c-8b4b-0bcd932688f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:36.844709 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bb48d6b3-7852-402c-8b4b-0bcd932688f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:36.845031 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bb48d6b3-7852-402c-8b4b-0bcd932688f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:36.976998 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bb48d6b3-7852-402c-8b4b-0bcd932688f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:36.984528 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-bb48d6b3-7852-402c-8b4b-0bcd932688f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.152482 Jun 22 18:39:36.985086 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 165/321] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:36 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:37.390585 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a2988bf5-aff0-4e72-a863-2b7807320c91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:37.391188 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a2988bf5-aff0-4e72-a863-2b7807320c91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:37.397247 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a2988bf5-aff0-4e72-a863-2b7807320c91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:37.397683 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a2988bf5-aff0-4e72-a863-2b7807320c91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:37.398429 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a2988bf5-aff0-4e72-a863-2b7807320c91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:37.398853 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a2988bf5-aff0-4e72-a863-2b7807320c91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:37.526548 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a2988bf5-aff0-4e72-a863-2b7807320c91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:37.535477 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a2988bf5-aff0-4e72-a863-2b7807320c91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:37.537037 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a2988bf5-aff0-4e72-a863-2b7807320c91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:37.538115 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a2988bf5-aff0-4e72-a863-2b7807320c91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.151535 Jun 22 18:39:37.538664 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 157/322] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:37 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:37.735294 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d327cc67-56c9-4e0c-95bd-72828188921d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:37.736014 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d327cc67-56c9-4e0c-95bd-72828188921d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:37.742150 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d327cc67-56c9-4e0c-95bd-72828188921d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:37.742682 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d327cc67-56c9-4e0c-95bd-72828188921d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:37.743532 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d327cc67-56c9-4e0c-95bd-72828188921d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:37.744027 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d327cc67-56c9-4e0c-95bd-72828188921d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:37.878634 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d327cc67-56c9-4e0c-95bd-72828188921d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:37.886279 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d327cc67-56c9-4e0c-95bd-72828188921d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.156372 Jun 22 18:39:37.886842 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 166/323] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:37 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:38.001471 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-82bd67e9-c220-42a9-8993-78bc1eb09011 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:38.002001 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-82bd67e9-c220-42a9-8993-78bc1eb09011 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:38.008302 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-82bd67e9-c220-42a9-8993-78bc1eb09011 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:38.008746 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-82bd67e9-c220-42a9-8993-78bc1eb09011 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:38.009503 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-82bd67e9-c220-42a9-8993-78bc1eb09011 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:38.009937 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-82bd67e9-c220-42a9-8993-78bc1eb09011 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:38.137266 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-82bd67e9-c220-42a9-8993-78bc1eb09011 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:38.145194 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-82bd67e9-c220-42a9-8993-78bc1eb09011 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.148114 Jun 22 18:39:38.145748 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 158/324] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:37 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:38.556581 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-dd3564dd-0492-4880-9e18-8f82585cf56b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:38.557180 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-dd3564dd-0492-4880-9e18-8f82585cf56b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:38.563670 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd3564dd-0492-4880-9e18-8f82585cf56b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:38.564145 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd3564dd-0492-4880-9e18-8f82585cf56b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:38.564905 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd3564dd-0492-4880-9e18-8f82585cf56b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:38.565336 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd3564dd-0492-4880-9e18-8f82585cf56b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:38.693766 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dd3564dd-0492-4880-9e18-8f82585cf56b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:38.701685 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dd3564dd-0492-4880-9e18-8f82585cf56b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:38.703178 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dd3564dd-0492-4880-9e18-8f82585cf56b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:38.704281 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-dd3564dd-0492-4880-9e18-8f82585cf56b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.151637 Jun 22 18:39:38.704830 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 167/325] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:38 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:38.902262 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-719d02bd-e130-44a5-824a-3bce5e12178a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:38.902872 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-719d02bd-e130-44a5-824a-3bce5e12178a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:38.910579 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-719d02bd-e130-44a5-824a-3bce5e12178a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:38.911047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-719d02bd-e130-44a5-824a-3bce5e12178a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:38.911803 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-719d02bd-e130-44a5-824a-3bce5e12178a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:38.912262 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-719d02bd-e130-44a5-824a-3bce5e12178a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:39.048186 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-719d02bd-e130-44a5-824a-3bce5e12178a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:39.055485 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-719d02bd-e130-44a5-824a-3bce5e12178a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.157063 Jun 22 18:39:39.056070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 159/326] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:38 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:39.161320 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-27fc5bc4-ba72-4a15-91c1-a654f8ee579a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:39.161922 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-27fc5bc4-ba72-4a15-91c1-a654f8ee579a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:39.167948 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-27fc5bc4-ba72-4a15-91c1-a654f8ee579a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:39.168394 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-27fc5bc4-ba72-4a15-91c1-a654f8ee579a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:39.169156 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-27fc5bc4-ba72-4a15-91c1-a654f8ee579a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:39.169587 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-27fc5bc4-ba72-4a15-91c1-a654f8ee579a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:39.300558 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-27fc5bc4-ba72-4a15-91c1-a654f8ee579a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:39.310054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-27fc5bc4-ba72-4a15-91c1-a654f8ee579a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.152200 Jun 22 18:39:39.311098 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 168/327] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:39 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:39.722472 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3079d1f7-b39e-4840-8849-039deb16679f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:39.723075 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3079d1f7-b39e-4840-8849-039deb16679f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:39.729188 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3079d1f7-b39e-4840-8849-039deb16679f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:39.729633 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3079d1f7-b39e-4840-8849-039deb16679f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:39.730394 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3079d1f7-b39e-4840-8849-039deb16679f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:39.730826 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3079d1f7-b39e-4840-8849-039deb16679f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:39.857965 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3079d1f7-b39e-4840-8849-039deb16679f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:39.867047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3079d1f7-b39e-4840-8849-039deb16679f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:39.868597 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3079d1f7-b39e-4840-8849-039deb16679f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:39.869706 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3079d1f7-b39e-4840-8849-039deb16679f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.151377 Jun 22 18:39:39.870259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 160/328] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:39 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:40.072054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-42aa3164-2d37-41d0-b5e3-ea977a566159 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:40.072655 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-42aa3164-2d37-41d0-b5e3-ea977a566159 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:40.079209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-42aa3164-2d37-41d0-b5e3-ea977a566159 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:40.079649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-42aa3164-2d37-41d0-b5e3-ea977a566159 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:40.080441 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-42aa3164-2d37-41d0-b5e3-ea977a566159 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:40.080872 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-42aa3164-2d37-41d0-b5e3-ea977a566159 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:40.084933 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:40.212611 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-42aa3164-2d37-41d0-b5e3-ea977a566159 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:40.221422 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-42aa3164-2d37-41d0-b5e3-ea977a566159 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.153172 Jun 22 18:39:40.221991 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 169/329] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:40 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:40.328585 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bc3c0a3a-daf3-425d-ac89-ab8a25d3cac4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:40.329195 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bc3c0a3a-daf3-425d-ac89-ab8a25d3cac4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:40.335681 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bc3c0a3a-daf3-425d-ac89-ab8a25d3cac4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:40.336167 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bc3c0a3a-daf3-425d-ac89-ab8a25d3cac4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:40.336933 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bc3c0a3a-daf3-425d-ac89-ab8a25d3cac4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:40.337365 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bc3c0a3a-daf3-425d-ac89-ab8a25d3cac4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:40.470814 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bc3c0a3a-daf3-425d-ac89-ab8a25d3cac4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:40.478199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bc3c0a3a-daf3-425d-ac89-ab8a25d3cac4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.153528 Jun 22 18:39:40.478765 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 161/330] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:40 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:40.888741 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-02b970c3-3c32-4bf1-8246-36a4f72f36a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:40.889342 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-02b970c3-3c32-4bf1-8246-36a4f72f36a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:40.895487 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-02b970c3-3c32-4bf1-8246-36a4f72f36a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:40.895962 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-02b970c3-3c32-4bf1-8246-36a4f72f36a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:40.896722 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-02b970c3-3c32-4bf1-8246-36a4f72f36a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:40.897233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-02b970c3-3c32-4bf1-8246-36a4f72f36a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:41.027059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-02b970c3-3c32-4bf1-8246-36a4f72f36a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:41.035888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-02b970c3-3c32-4bf1-8246-36a4f72f36a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:41.037382 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-02b970c3-3c32-4bf1-8246-36a4f72f36a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:41.038463 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-02b970c3-3c32-4bf1-8246-36a4f72f36a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.153785 Jun 22 18:39:41.039034 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 170/331] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:40 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:41.239437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f5ab729b-abc0-4b33-8092-032d5beff9e4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:41.240062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f5ab729b-abc0-4b33-8092-032d5beff9e4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:41.246022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5ab729b-abc0-4b33-8092-032d5beff9e4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:41.246458 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5ab729b-abc0-4b33-8092-032d5beff9e4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:41.247204 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5ab729b-abc0-4b33-8092-032d5beff9e4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:41.247626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5ab729b-abc0-4b33-8092-032d5beff9e4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:41.454960 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f5ab729b-abc0-4b33-8092-032d5beff9e4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:41.462321 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f5ab729b-abc0-4b33-8092-032d5beff9e4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.227888 Jun 22 18:39:41.462874 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 162/332] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:41 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:41.494936 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3b8bd29d-870d-401f-b57a-df9255ba85ea tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:41.495532 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3b8bd29d-870d-401f-b57a-df9255ba85ea tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:41.502129 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3b8bd29d-870d-401f-b57a-df9255ba85ea tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:41.502564 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3b8bd29d-870d-401f-b57a-df9255ba85ea tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:41.503314 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3b8bd29d-870d-401f-b57a-df9255ba85ea tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:41.503740 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3b8bd29d-870d-401f-b57a-df9255ba85ea tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:41.635368 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3b8bd29d-870d-401f-b57a-df9255ba85ea tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:41.643274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3b8bd29d-870d-401f-b57a-df9255ba85ea tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.152058 Jun 22 18:39:41.643869 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 171/333] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:41 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:42.056554 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ab690a72-a8e6-4ccd-b8fd-7ce111d6282b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:42.057152 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ab690a72-a8e6-4ccd-b8fd-7ce111d6282b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:42.063353 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ab690a72-a8e6-4ccd-b8fd-7ce111d6282b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:42.063790 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ab690a72-a8e6-4ccd-b8fd-7ce111d6282b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:42.064924 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ab690a72-a8e6-4ccd-b8fd-7ce111d6282b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:42.065035 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ab690a72-a8e6-4ccd-b8fd-7ce111d6282b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:42.342606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ab690a72-a8e6-4ccd-b8fd-7ce111d6282b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:42.352767 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ab690a72-a8e6-4ccd-b8fd-7ce111d6282b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:42.354190 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ab690a72-a8e6-4ccd-b8fd-7ce111d6282b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:42.355288 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ab690a72-a8e6-4ccd-b8fd-7ce111d6282b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1406 microversion: 2.20 time: 0.302531 Jun 22 18:39:42.356030 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 163/334] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:42 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:42.478318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6ad79416-d37c-43bc-ad08-8011f0aca46a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:42.478954 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6ad79416-d37c-43bc-ad08-8011f0aca46a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:42.486237 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6ad79416-d37c-43bc-ad08-8011f0aca46a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:42.486799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6ad79416-d37c-43bc-ad08-8011f0aca46a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:42.487614 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6ad79416-d37c-43bc-ad08-8011f0aca46a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:42.488120 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6ad79416-d37c-43bc-ad08-8011f0aca46a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:42.616868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6ad79416-d37c-43bc-ad08-8011f0aca46a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:42.624899 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6ad79416-d37c-43bc-ad08-8011f0aca46a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.150249 Jun 22 18:39:42.625456 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 172/335] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:42 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:42.661358 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-0fd77205-5963-469f-b5e4-fdfdb64659ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:42.661957 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0fd77205-5963-469f-b5e4-fdfdb64659ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:42.667930 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0fd77205-5963-469f-b5e4-fdfdb64659ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:42.668380 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0fd77205-5963-469f-b5e4-fdfdb64659ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:42.669136 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0fd77205-5963-469f-b5e4-fdfdb64659ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:42.669569 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0fd77205-5963-469f-b5e4-fdfdb64659ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:42.674360 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:42.807490 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-0fd77205-5963-469f-b5e4-fdfdb64659ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:42.814988 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-0fd77205-5963-469f-b5e4-fdfdb64659ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.157562 Jun 22 18:39:42.815594 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 164/336] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:42 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:43.375403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-fc98a0c6-48ae-4a60-a5f5-dd9d725eeb7e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:43.376202 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-fc98a0c6-48ae-4a60-a5f5-dd9d725eeb7e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:43.382980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fc98a0c6-48ae-4a60-a5f5-dd9d725eeb7e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:43.383459 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fc98a0c6-48ae-4a60-a5f5-dd9d725eeb7e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:43.384236 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fc98a0c6-48ae-4a60-a5f5-dd9d725eeb7e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:43.384665 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fc98a0c6-48ae-4a60-a5f5-dd9d725eeb7e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:43.551562 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fc98a0c6-48ae-4a60-a5f5-dd9d725eeb7e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:43.564723 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fc98a0c6-48ae-4a60-a5f5-dd9d725eeb7e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:43.566186 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fc98a0c6-48ae-4a60-a5f5-dd9d725eeb7e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:43.567342 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-fc98a0c6-48ae-4a60-a5f5-dd9d725eeb7e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1598 microversion: 2.20 time: 0.196776 Jun 22 18:39:43.567927 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 173/337] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:39:43 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1598 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:39:43.587851 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ba22054f-8386-4a49-b732-66d98226e7ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:43.588338 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ba22054f-8386-4a49-b732-66d98226e7ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:43.597175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ba22054f-8386-4a49-b732-66d98226e7ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:43.597663 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ba22054f-8386-4a49-b732-66d98226e7ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:43.598470 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ba22054f-8386-4a49-b732-66d98226e7ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:43.599008 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ba22054f-8386-4a49-b732-66d98226e7ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:43.642799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b21aed6b-11d8-4e36-96ff-280d8dde1ad9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:43.643448 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b21aed6b-11d8-4e36-96ff-280d8dde1ad9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:43.650277 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b21aed6b-11d8-4e36-96ff-280d8dde1ad9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:43.650713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b21aed6b-11d8-4e36-96ff-280d8dde1ad9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:43.651481 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b21aed6b-11d8-4e36-96ff-280d8dde1ad9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:43.651939 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b21aed6b-11d8-4e36-96ff-280d8dde1ad9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:43.693277 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ba22054f-8386-4a49-b732-66d98226e7ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109387 Jun 22 18:39:43.700068 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 165/338] 10.222.0.18 () {60 vars in 1315 bytes} [Wed Jun 22 18:39:43 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:39:43.817896 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b21aed6b-11d8-4e36-96ff-280d8dde1ad9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:43.826575 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b21aed6b-11d8-4e36-96ff-280d8dde1ad9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.188502 Jun 22 18:39:43.837946 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-0465efce-7be5-47d0-a350-b6a56cc47a1f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:43.838786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0465efce-7be5-47d0-a350-b6a56cc47a1f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:43.839815 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 174/339] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:43 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:43.850172 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0465efce-7be5-47d0-a350-b6a56cc47a1f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:43.850623 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0465efce-7be5-47d0-a350-b6a56cc47a1f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:43.851395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0465efce-7be5-47d0-a350-b6a56cc47a1f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:43.851855 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0465efce-7be5-47d0-a350-b6a56cc47a1f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:44.141283 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-0465efce-7be5-47d0-a350-b6a56cc47a1f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:44.149204 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-0465efce-7be5-47d0-a350-b6a56cc47a1f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.320848 Jun 22 18:39:44.159056 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 166/340] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:43 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:44.847863 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9df471e3-4470-4f26-9d75-50132172b889 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:44.848550 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9df471e3-4470-4f26-9d75-50132172b889 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:44.855174 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9df471e3-4470-4f26-9d75-50132172b889 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:44.856020 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9df471e3-4470-4f26-9d75-50132172b889 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:44.856787 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9df471e3-4470-4f26-9d75-50132172b889 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:44.857366 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9df471e3-4470-4f26-9d75-50132172b889 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:45.078600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9df471e3-4470-4f26-9d75-50132172b889 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:45.080421 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-3ffaf398-5ca0-4b2f-b5fd-a268e4803f22 req-bbef6f99-b6cb-4919-beec-0c19ed682673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688c6da6-d454-4dc0-8335-b0a4e16f5824", "tag": "24070ee1-9191-4d52-8234-91ae16aa72a0"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:39:45.086245 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9df471e3-4470-4f26-9d75-50132172b889 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.243275 Jun 22 18:39:45.087017 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 175/341] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:44 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:45.101447 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-3ffaf398-5ca0-4b2f-b5fd-a268e4803f22 req-bbef6f99-b6cb-4919-beec-0c19ed682673 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:45.101881 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-3ffaf398-5ca0-4b2f-b5fd-a268e4803f22 req-bbef6f99-b6cb-4919-beec-0c19ed682673 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:45.114475 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-3ffaf398-5ca0-4b2f-b5fd-a268e4803f22 req-bbef6f99-b6cb-4919-beec-0c19ed682673 service nova] Creating event network-changed:24070ee1-9191-4d52-8234-91ae16aa72a0 for instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 on hv-cinder-81268 Jun 22 18:39:45.120341 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-3ffaf398-5ca0-4b2f-b5fd-a268e4803f22 req-bbef6f99-b6cb-4919-beec-0c19ed682673 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043767 Jun 22 18:39:45.121192 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 167/342] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:39:45.168698 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-785304f2-e92c-43a9-8fcc-d85f204b03b0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:45.169653 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-785304f2-e92c-43a9-8fcc-d85f204b03b0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:45.199291 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-785304f2-e92c-43a9-8fcc-d85f204b03b0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:45.199794 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-785304f2-e92c-43a9-8fcc-d85f204b03b0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:45.200677 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-785304f2-e92c-43a9-8fcc-d85f204b03b0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:45.201115 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-785304f2-e92c-43a9-8fcc-d85f204b03b0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:45.351556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-785304f2-e92c-43a9-8fcc-d85f204b03b0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:45.360134 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-785304f2-e92c-43a9-8fcc-d85f204b03b0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.197333 Jun 22 18:39:45.370009 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 176/343] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:45 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:46.104213 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ea4f3a2f-e138-49da-b32e-25b2f6f44416 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:46.105353 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ea4f3a2f-e138-49da-b32e-25b2f6f44416 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:46.117540 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ea4f3a2f-e138-49da-b32e-25b2f6f44416 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:46.118479 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ea4f3a2f-e138-49da-b32e-25b2f6f44416 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:46.120535 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ea4f3a2f-e138-49da-b32e-25b2f6f44416 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:46.121237 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ea4f3a2f-e138-49da-b32e-25b2f6f44416 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:46.347255 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ea4f3a2f-e138-49da-b32e-25b2f6f44416 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:46.355892 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ea4f3a2f-e138-49da-b32e-25b2f6f44416 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.256876 Jun 22 18:39:46.358009 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 168/344] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:46 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:46.383205 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-35aa8549-f6c9-44ea-83b9-43cd775f4613 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:46.384633 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-35aa8549-f6c9-44ea-83b9-43cd775f4613 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:46.393924 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-35aa8549-f6c9-44ea-83b9-43cd775f4613 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:46.394594 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-35aa8549-f6c9-44ea-83b9-43cd775f4613 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:46.395552 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-35aa8549-f6c9-44ea-83b9-43cd775f4613 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:46.396173 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-35aa8549-f6c9-44ea-83b9-43cd775f4613 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:46.580917 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-35aa8549-f6c9-44ea-83b9-43cd775f4613 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:46.594766 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-35aa8549-f6c9-44ea-83b9-43cd775f4613 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.220692 Jun 22 18:39:46.596101 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 177/345] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:46 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:47.374564 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7181f2e8-3a47-4656-86a2-6159303c7fc9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:47.375224 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7181f2e8-3a47-4656-86a2-6159303c7fc9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:47.382787 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7181f2e8-3a47-4656-86a2-6159303c7fc9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:47.384548 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7181f2e8-3a47-4656-86a2-6159303c7fc9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:47.391245 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7181f2e8-3a47-4656-86a2-6159303c7fc9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:47.392602 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7181f2e8-3a47-4656-86a2-6159303c7fc9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:47.611010 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7181f2e8-3a47-4656-86a2-6159303c7fc9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:47.612959 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-46201b07-f5d4-4f12-93fc-f6e7f4a44522 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:47.614080 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-46201b07-f5d4-4f12-93fc-f6e7f4a44522 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:47.621618 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7181f2e8-3a47-4656-86a2-6159303c7fc9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.249264 Jun 22 18:39:47.623260 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 169/346] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:47 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:47.627496 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46201b07-f5d4-4f12-93fc-f6e7f4a44522 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:47.627982 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46201b07-f5d4-4f12-93fc-f6e7f4a44522 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:47.633084 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46201b07-f5d4-4f12-93fc-f6e7f4a44522 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:47.633566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46201b07-f5d4-4f12-93fc-f6e7f4a44522 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:47.857036 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-46201b07-f5d4-4f12-93fc-f6e7f4a44522 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:47.865965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-46201b07-f5d4-4f12-93fc-f6e7f4a44522 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.257932 Jun 22 18:39:47.876686 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 178/347] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:47 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:48.640921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1ffcf24b-3d3d-4678-8ffa-f0589010b546 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:48.642066 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1ffcf24b-3d3d-4678-8ffa-f0589010b546 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:48.651884 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1ffcf24b-3d3d-4678-8ffa-f0589010b546 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:48.652611 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1ffcf24b-3d3d-4678-8ffa-f0589010b546 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:48.653851 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1ffcf24b-3d3d-4678-8ffa-f0589010b546 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:48.654564 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1ffcf24b-3d3d-4678-8ffa-f0589010b546 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:48.825072 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1ffcf24b-3d3d-4678-8ffa-f0589010b546 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:48.826899 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1539401415", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452"}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:39:48.835393 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1ffcf24b-3d3d-4678-8ffa-f0589010b546 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.198876 Jun 22 18:39:48.844849 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 170/348] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:48 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:48.883523 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-9c6ac4e4-1bfd-4ec2-b5b0-dc29599cc65f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:48.884252 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-9c6ac4e4-1bfd-4ec2-b5b0-dc29599cc65f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:48.887823 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.network.neutron [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] validate_networks() for None {{(pid=129744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:39:48.896903 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9c6ac4e4-1bfd-4ec2-b5b0-dc29599cc65f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:48.897774 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9c6ac4e4-1bfd-4ec2-b5b0-dc29599cc65f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:48.898575 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9c6ac4e4-1bfd-4ec2-b5b0-dc29599cc65f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:48.899008 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9c6ac4e4-1bfd-4ec2-b5b0-dc29599cc65f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:49.057290 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-9c6ac4e4-1bfd-4ec2-b5b0-dc29599cc65f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:49.066395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-9c6ac4e4-1bfd-4ec2-b5b0-dc29599cc65f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.187872 Jun 22 18:39:49.066960 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 171/349] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:48 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:49.186836 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Flavor limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:39:49.187294 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Image limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:39:49.187903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Flavor pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:39:49.188425 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Image pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:39:49.188836 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:39:49.198651 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:49.199094 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:49.199916 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:49.200343 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:49.214873 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=100 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:49.221766 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Getting quotas for project f7201f0c6ab64901a15c6b8588a8f3fd. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:39:49.228445 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Getting quotas for user 1fcb1a1d12c543378d9405606ad84523 and project f7201f0c6ab64901a15c6b8588a8f3fd. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:39:49.240644 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Going to run 1 instances... {{(pid=129744) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:39:49.243154 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:39:49.294917 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d58a918b-db5f-477a-b183-2520418c7043 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.472504 Jun 22 18:39:49.296280 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 179/350] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:39:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:39:49.306086 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b456d711-3f99-4f21-8de4-2098f981d0ed tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:49.306687 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b456d711-3f99-4f21-8de4-2098f981d0ed tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:49.313315 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=97 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:49.368774 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b456d711-3f99-4f21-8de4-2098f981d0ed tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:49.380286 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b456d711-3f99-4f21-8de4-2098f981d0ed tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1215 microversion: 2.1 time: 0.078062 Jun 22 18:39:49.380851 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 172/351] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:49 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:49.736514 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-4ed3e758-1091-4669-8562-e6401de5edae req-2cd1b308-2089-47d3-b227-cd57d45aa583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10bda053-aa92-4811-ae79-e5ed926c5860", "name": "network-vif-plugged", "status": "completed", "tag": "a0636fe7-12f6-4d9e-8831-3d1efe728a6c"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:39:49.759492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-4ed3e758-1091-4669-8562-e6401de5edae req-2cd1b308-2089-47d3-b227-cd57d45aa583 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:49.760181 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-4ed3e758-1091-4669-8562-e6401de5edae req-2cd1b308-2089-47d3-b227-cd57d45aa583 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:49.776869 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-4ed3e758-1091-4669-8562-e6401de5edae req-2cd1b308-2089-47d3-b227-cd57d45aa583 service nova] Creating event network-vif-plugged:a0636fe7-12f6-4d9e-8831-3d1efe728a6c for instance 10bda053-aa92-4811-ae79-e5ed926c5860 on hv-cinder-81268 Jun 22 18:39:49.782659 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-4ed3e758-1091-4669-8562-e6401de5edae req-2cd1b308-2089-47d3-b227-cd57d45aa583 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057411 Jun 22 18:39:49.783712 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 180/352] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:39:49.853450 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d21067cf-fe84-4eb3-9230-d66ba066a37a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:49.855008 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d21067cf-fe84-4eb3-9230-d66ba066a37a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:49.863866 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d21067cf-fe84-4eb3-9230-d66ba066a37a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:49.864703 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d21067cf-fe84-4eb3-9230-d66ba066a37a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:49.865860 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d21067cf-fe84-4eb3-9230-d66ba066a37a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:49.866378 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d21067cf-fe84-4eb3-9230-d66ba066a37a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:50.070134 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d21067cf-fe84-4eb3-9230-d66ba066a37a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:50.084171 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9060a9e2-9b2b-47fd-9f2e-cc6526be4d40 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:50.084874 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9060a9e2-9b2b-47fd-9f2e-cc6526be4d40 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:50.090289 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d21067cf-fe84-4eb3-9230-d66ba066a37a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.241269 Jun 22 18:39:50.091977 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 173/353] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:49 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:50.095717 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9060a9e2-9b2b-47fd-9f2e-cc6526be4d40 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:50.096188 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9060a9e2-9b2b-47fd-9f2e-cc6526be4d40 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:50.096964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9060a9e2-9b2b-47fd-9f2e-cc6526be4d40 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:50.097398 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9060a9e2-9b2b-47fd-9f2e-cc6526be4d40 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:50.238601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9060a9e2-9b2b-47fd-9f2e-cc6526be4d40 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:50.246029 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9060a9e2-9b2b-47fd-9f2e-cc6526be4d40 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.166596 Jun 22 18:39:50.246578 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 181/354] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:50 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:50.398523 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-46581da6-f727-4191-bf40-e1fc54c15bad tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:50.399461 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-46581da6-f727-4191-bf40-e1fc54c15bad tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:50.405549 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-46581da6-f727-4191-bf40-e1fc54c15bad tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:50.405995 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-46581da6-f727-4191-bf40-e1fc54c15bad tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:50.406762 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-46581da6-f727-4191-bf40-e1fc54c15bad tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:50.407199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-46581da6-f727-4191-bf40-e1fc54c15bad tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:50.466678 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-46581da6-f727-4191-bf40-e1fc54c15bad tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:50.474725 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-46581da6-f727-4191-bf40-e1fc54c15bad tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1267 microversion: 2.1 time: 0.080425 Jun 22 18:39:50.475281 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 174/355] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:50 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:51.107894 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-293cb778-abf4-42e6-91b0-df39fa79972a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:51.108407 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-293cb778-abf4-42e6-91b0-df39fa79972a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:51.114548 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-293cb778-abf4-42e6-91b0-df39fa79972a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:51.114999 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-293cb778-abf4-42e6-91b0-df39fa79972a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:51.115751 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-293cb778-abf4-42e6-91b0-df39fa79972a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:51.116208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-293cb778-abf4-42e6-91b0-df39fa79972a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:51.252389 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-293cb778-abf4-42e6-91b0-df39fa79972a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:51.260682 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-293cb778-abf4-42e6-91b0-df39fa79972a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.157369 Jun 22 18:39:51.261478 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 182/356] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:51 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:51.262807 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4ecb1a09-bd66-4aec-ae8c-2f9f8a5c1eac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:51.263414 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-4ecb1a09-bd66-4aec-ae8c-2f9f8a5c1eac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:51.271446 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4ecb1a09-bd66-4aec-ae8c-2f9f8a5c1eac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:51.271921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4ecb1a09-bd66-4aec-ae8c-2f9f8a5c1eac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:51.272691 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4ecb1a09-bd66-4aec-ae8c-2f9f8a5c1eac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:51.273120 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4ecb1a09-bd66-4aec-ae8c-2f9f8a5c1eac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:51.409393 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4ecb1a09-bd66-4aec-ae8c-2f9f8a5c1eac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:51.421198 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4ecb1a09-bd66-4aec-ae8c-2f9f8a5c1eac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.162357 Jun 22 18:39:51.421725 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 175/357] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:51 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:51.492490 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-dc3840c5-f884-4f7d-9b65-ce97286ba189 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:51.493099 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-dc3840c5-f884-4f7d-9b65-ce97286ba189 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:51.499451 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dc3840c5-f884-4f7d-9b65-ce97286ba189 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:51.500574 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dc3840c5-f884-4f7d-9b65-ce97286ba189 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:51.501566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dc3840c5-f884-4f7d-9b65-ce97286ba189 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:51.502002 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dc3840c5-f884-4f7d-9b65-ce97286ba189 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:51.568080 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dc3840c5-f884-4f7d-9b65-ce97286ba189 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:51.575678 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-dc3840c5-f884-4f7d-9b65-ce97286ba189 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1275 microversion: 2.1 time: 0.086951 Jun 22 18:39:51.576287 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 183/358] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:51 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:52.278358 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5193027f-26c3-424f-9724-f8b05433e373 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:52.278893 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5193027f-26c3-424f-9724-f8b05433e373 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:52.286215 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5193027f-26c3-424f-9724-f8b05433e373 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:52.286654 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5193027f-26c3-424f-9724-f8b05433e373 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:52.287409 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5193027f-26c3-424f-9724-f8b05433e373 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:52.287852 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5193027f-26c3-424f-9724-f8b05433e373 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:52.423959 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5193027f-26c3-424f-9724-f8b05433e373 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:52.431952 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5193027f-26c3-424f-9724-f8b05433e373 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.157494 Jun 22 18:39:52.435883 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 176/359] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:52 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:52.438640 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cccb7c82-f357-4dba-9bb9-83013eabf50d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:52.439251 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cccb7c82-f357-4dba-9bb9-83013eabf50d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:52.445374 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cccb7c82-f357-4dba-9bb9-83013eabf50d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:52.445813 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cccb7c82-f357-4dba-9bb9-83013eabf50d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:52.446570 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cccb7c82-f357-4dba-9bb9-83013eabf50d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:52.446999 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cccb7c82-f357-4dba-9bb9-83013eabf50d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:52.577813 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cccb7c82-f357-4dba-9bb9-83013eabf50d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:52.585600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cccb7c82-f357-4dba-9bb9-83013eabf50d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.151375 Jun 22 18:39:52.586164 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 184/360] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:52 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:52.592918 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7042f84d-950c-4e9b-8225-8454378c2a45 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:52.593846 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7042f84d-950c-4e9b-8225-8454378c2a45 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:52.600122 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7042f84d-950c-4e9b-8225-8454378c2a45 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:52.600571 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7042f84d-950c-4e9b-8225-8454378c2a45 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:52.601393 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7042f84d-950c-4e9b-8225-8454378c2a45 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:52.601884 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7042f84d-950c-4e9b-8225-8454378c2a45 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:52.666065 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7042f84d-950c-4e9b-8225-8454378c2a45 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:52.673912 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7042f84d-950c-4e9b-8225-8454378c2a45 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1275 microversion: 2.1 time: 0.084720 Jun 22 18:39:52.674833 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 177/361] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:52 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:53.448307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d834e7ed-ec41-4837-96a3-9e916f4b9357 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:53.448941 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d834e7ed-ec41-4837-96a3-9e916f4b9357 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:53.455061 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d834e7ed-ec41-4837-96a3-9e916f4b9357 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:53.455508 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d834e7ed-ec41-4837-96a3-9e916f4b9357 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:53.456307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d834e7ed-ec41-4837-96a3-9e916f4b9357 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:53.456735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d834e7ed-ec41-4837-96a3-9e916f4b9357 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:53.585387 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d834e7ed-ec41-4837-96a3-9e916f4b9357 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:53.592699 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d834e7ed-ec41-4837-96a3-9e916f4b9357 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.148242 Jun 22 18:39:53.593249 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 185/362] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:53 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:53.602293 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d72aaaa9-36f6-40da-9f7d-3dfb1f194010 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:53.602904 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d72aaaa9-36f6-40da-9f7d-3dfb1f194010 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:53.609942 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d72aaaa9-36f6-40da-9f7d-3dfb1f194010 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:53.610574 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d72aaaa9-36f6-40da-9f7d-3dfb1f194010 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:53.611347 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d72aaaa9-36f6-40da-9f7d-3dfb1f194010 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:53.611783 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d72aaaa9-36f6-40da-9f7d-3dfb1f194010 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:53.692861 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-35cfe7af-cce4-4ab9-94df-3e10b258172f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:53.693466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-35cfe7af-cce4-4ab9-94df-3e10b258172f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:53.699500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-35cfe7af-cce4-4ab9-94df-3e10b258172f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:53.700003 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-35cfe7af-cce4-4ab9-94df-3e10b258172f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:53.700766 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-35cfe7af-cce4-4ab9-94df-3e10b258172f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:53.701195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-35cfe7af-cce4-4ab9-94df-3e10b258172f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:53.737422 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d72aaaa9-36f6-40da-9f7d-3dfb1f194010 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:53.746317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d72aaaa9-36f6-40da-9f7d-3dfb1f194010 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.147798 Jun 22 18:39:53.756199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 178/363] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:53 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:53.768323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-35cfe7af-cce4-4ab9-94df-3e10b258172f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:53.777135 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-35cfe7af-cce4-4ab9-94df-3e10b258172f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1275 microversion: 2.1 time: 0.088830 Jun 22 18:39:53.777849 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 186/364] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:53 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:54.609923 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c72b04b1-288e-4222-b8c2-416be098c7c6 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:54.610534 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c72b04b1-288e-4222-b8c2-416be098c7c6 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:54.617086 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c72b04b1-288e-4222-b8c2-416be098c7c6 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:54.617532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c72b04b1-288e-4222-b8c2-416be098c7c6 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:54.618292 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c72b04b1-288e-4222-b8c2-416be098c7c6 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:54.618724 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c72b04b1-288e-4222-b8c2-416be098c7c6 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:54.762307 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c72b04b1-288e-4222-b8c2-416be098c7c6 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:54.762823 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e412a61c-8702-421b-ba76-5091b6359288 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:54.763453 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e412a61c-8702-421b-ba76-5091b6359288 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:54.770560 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e412a61c-8702-421b-ba76-5091b6359288 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:54.770995 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e412a61c-8702-421b-ba76-5091b6359288 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:54.771526 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c72b04b1-288e-4222-b8c2-416be098c7c6 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.165613 Jun 22 18:39:54.771753 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e412a61c-8702-421b-ba76-5091b6359288 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:54.772209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e412a61c-8702-421b-ba76-5091b6359288 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:54.772452 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 179/365] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:54 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:54.776796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=100 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:54.794215 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-93114b74-b802-4361-9891-5ef3341dc496 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:54.794926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-93114b74-b802-4361-9891-5ef3341dc496 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:54.801483 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-93114b74-b802-4361-9891-5ef3341dc496 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:54.801937 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-93114b74-b802-4361-9891-5ef3341dc496 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:54.802740 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-93114b74-b802-4361-9891-5ef3341dc496 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:54.803201 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-93114b74-b802-4361-9891-5ef3341dc496 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:54.869957 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-93114b74-b802-4361-9891-5ef3341dc496 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:54.877665 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-93114b74-b802-4361-9891-5ef3341dc496 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1275 microversion: 2.1 time: 0.087157 Jun 22 18:39:54.878225 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 180/366] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:54 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:54.908243 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e412a61c-8702-421b-ba76-5091b6359288 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:54.915751 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e412a61c-8702-421b-ba76-5091b6359288 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.156898 Jun 22 18:39:54.916338 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 187/367] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:54 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:55.788477 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e2eae5d8-c275-4995-88c8-2dd78ef43bbb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:55.789087 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e2eae5d8-c275-4995-88c8-2dd78ef43bbb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:55.795532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e2eae5d8-c275-4995-88c8-2dd78ef43bbb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:55.796015 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e2eae5d8-c275-4995-88c8-2dd78ef43bbb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:55.796832 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e2eae5d8-c275-4995-88c8-2dd78ef43bbb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:55.797419 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e2eae5d8-c275-4995-88c8-2dd78ef43bbb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:55.895046 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0002fa0a-7589-4a70-8c0a-b720e394703c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:55.895639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0002fa0a-7589-4a70-8c0a-b720e394703c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:55.901874 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0002fa0a-7589-4a70-8c0a-b720e394703c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:55.902322 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0002fa0a-7589-4a70-8c0a-b720e394703c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:55.903076 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0002fa0a-7589-4a70-8c0a-b720e394703c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:55.903498 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0002fa0a-7589-4a70-8c0a-b720e394703c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:55.929792 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e2eae5d8-c275-4995-88c8-2dd78ef43bbb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:55.937973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e2eae5d8-c275-4995-88c8-2dd78ef43bbb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.152818 Jun 22 18:39:55.938631 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 181/368] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:55 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:55.943014 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d02f7629-8e9e-4287-80b3-07692cc92c01 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:55.943739 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d02f7629-8e9e-4287-80b3-07692cc92c01 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:55.949610 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d02f7629-8e9e-4287-80b3-07692cc92c01 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:55.950049 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d02f7629-8e9e-4287-80b3-07692cc92c01 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:55.950805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d02f7629-8e9e-4287-80b3-07692cc92c01 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:55.951231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d02f7629-8e9e-4287-80b3-07692cc92c01 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:55.964859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0002fa0a-7589-4a70-8c0a-b720e394703c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:55.972231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0002fa0a-7589-4a70-8c0a-b720e394703c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1275 microversion: 2.1 time: 0.081650 Jun 22 18:39:55.972791 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 188/369] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:55 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1275 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:56.089629 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d02f7629-8e9e-4287-80b3-07692cc92c01 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:56.093069 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:56.100374 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d02f7629-8e9e-4287-80b3-07692cc92c01 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.160777 Jun 22 18:39:56.100937 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 182/370] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:55 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:56.954253 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8ac305f1-7ff9-4844-bac8-e2d7c576143a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:56.954832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8ac305f1-7ff9-4844-bac8-e2d7c576143a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:56.960794 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8ac305f1-7ff9-4844-bac8-e2d7c576143a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:56.961351 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8ac305f1-7ff9-4844-bac8-e2d7c576143a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:56.962546 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8ac305f1-7ff9-4844-bac8-e2d7c576143a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:56.963148 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8ac305f1-7ff9-4844-bac8-e2d7c576143a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:56.989818 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-950685e3-4e0f-420a-b928-0361e99d7f2b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:56.989818 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-950685e3-4e0f-420a-b928-0361e99d7f2b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:56.995886 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-950685e3-4e0f-420a-b928-0361e99d7f2b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:56.996294 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-950685e3-4e0f-420a-b928-0361e99d7f2b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:56.996991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-950685e3-4e0f-420a-b928-0361e99d7f2b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:56.997418 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-950685e3-4e0f-420a-b928-0361e99d7f2b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:57.073097 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-950685e3-4e0f-420a-b928-0361e99d7f2b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:57.081186 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-950685e3-4e0f-420a-b928-0361e99d7f2b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1275 microversion: 2.1 time: 0.097069 Jun 22 18:39:57.089104 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 183/371] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:56 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:57.119675 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c69147f1-4f2e-4c36-beeb-6b7ae27767d1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:57.120312 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c69147f1-4f2e-4c36-beeb-6b7ae27767d1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:57.121372 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8ac305f1-7ff9-4844-bac8-e2d7c576143a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:57.127192 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c69147f1-4f2e-4c36-beeb-6b7ae27767d1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:57.127640 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c69147f1-4f2e-4c36-beeb-6b7ae27767d1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:57.128570 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c69147f1-4f2e-4c36-beeb-6b7ae27767d1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:57.129002 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c69147f1-4f2e-4c36-beeb-6b7ae27767d1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:57.134918 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8ac305f1-7ff9-4844-bac8-e2d7c576143a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.184395 Jun 22 18:39:57.139877 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 189/372] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:56 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:57.264962 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c69147f1-4f2e-4c36-beeb-6b7ae27767d1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:57.272918 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c69147f1-4f2e-4c36-beeb-6b7ae27767d1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.158311 Jun 22 18:39:57.273474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 184/373] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:57 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:58.098479 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a9e38ab3-26c4-4bb1-be44-bc4676595f4c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:58.099097 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a9e38ab3-26c4-4bb1-be44-bc4676595f4c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:58.105414 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a9e38ab3-26c4-4bb1-be44-bc4676595f4c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:58.105857 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a9e38ab3-26c4-4bb1-be44-bc4676595f4c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:58.106797 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a9e38ab3-26c4-4bb1-be44-bc4676595f4c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:58.107233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a9e38ab3-26c4-4bb1-be44-bc4676595f4c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:58.152230 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-526fcdb9-4de1-4d46-8feb-bbe261e673d9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:58.152955 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-526fcdb9-4de1-4d46-8feb-bbe261e673d9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:58.161577 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-526fcdb9-4de1-4d46-8feb-bbe261e673d9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:58.162152 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-526fcdb9-4de1-4d46-8feb-bbe261e673d9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:58.162987 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-526fcdb9-4de1-4d46-8feb-bbe261e673d9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:58.163542 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-526fcdb9-4de1-4d46-8feb-bbe261e673d9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:58.180706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a9e38ab3-26c4-4bb1-be44-bc4676595f4c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:58.189356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a9e38ab3-26c4-4bb1-be44-bc4676595f4c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1275 microversion: 2.1 time: 0.094806 Jun 22 18:39:58.190244 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 190/374] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:58 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:58.290539 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-fb8cd5c7-3bff-47f5-8f83-d3200a046580 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:58.291150 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-fb8cd5c7-3bff-47f5-8f83-d3200a046580 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:58.299182 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fb8cd5c7-3bff-47f5-8f83-d3200a046580 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:58.299673 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fb8cd5c7-3bff-47f5-8f83-d3200a046580 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:58.300749 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fb8cd5c7-3bff-47f5-8f83-d3200a046580 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:58.301439 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fb8cd5c7-3bff-47f5-8f83-d3200a046580 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:58.304233 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-526fcdb9-4de1-4d46-8feb-bbe261e673d9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:58.315134 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-526fcdb9-4de1-4d46-8feb-bbe261e673d9 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.166697 Jun 22 18:39:58.316046 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 185/375] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:58 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:58.450652 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fb8cd5c7-3bff-47f5-8f83-d3200a046580 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:58.458599 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-fb8cd5c7-3bff-47f5-8f83-d3200a046580 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.171965 Jun 22 18:39:58.459429 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 191/376] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:58 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:39:59.208460 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-182c2767-68d6-4161-be1a-ba4a85ef7e28 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:59.209081 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-182c2767-68d6-4161-be1a-ba4a85ef7e28 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:59.215272 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-182c2767-68d6-4161-be1a-ba4a85ef7e28 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:59.215715 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-182c2767-68d6-4161-be1a-ba4a85ef7e28 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:59.216508 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-182c2767-68d6-4161-be1a-ba4a85ef7e28 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:59.216940 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-182c2767-68d6-4161-be1a-ba4a85ef7e28 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:59.279612 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-182c2767-68d6-4161-be1a-ba4a85ef7e28 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:59.287449 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-182c2767-68d6-4161-be1a-ba4a85ef7e28 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1275 microversion: 2.1 time: 0.085453 Jun 22 18:39:59.288454 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 186/377] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:59 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:59.332089 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cbdb420b-4a42-45ce-a044-35c2d4872bd7 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:59.332693 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cbdb420b-4a42-45ce-a044-35c2d4872bd7 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:59.334531 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:59.335186 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=6 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:59.341295 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cbdb420b-4a42-45ce-a044-35c2d4872bd7 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:59.341741 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cbdb420b-4a42-45ce-a044-35c2d4872bd7 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:59.342533 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cbdb420b-4a42-45ce-a044-35c2d4872bd7 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:59.342960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cbdb420b-4a42-45ce-a044-35c2d4872bd7 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:59.474941 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-cdabc29a-dfdd-4572-86b9-360b7fbb5c54 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:39:59.475543 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-cdabc29a-dfdd-4572-86b9-360b7fbb5c54 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:39:59.478576 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:39:59.482640 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cdabc29a-dfdd-4572-86b9-360b7fbb5c54 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:59.483287 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cdabc29a-dfdd-4572-86b9-360b7fbb5c54 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:59.484556 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cdabc29a-dfdd-4572-86b9-360b7fbb5c54 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:39:59.485134 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cdabc29a-dfdd-4572-86b9-360b7fbb5c54 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:39:59.496210 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cbdb420b-4a42-45ce-a044-35c2d4872bd7 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:59.504982 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cbdb420b-4a42-45ce-a044-35c2d4872bd7 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.177177 Jun 22 18:39:59.505654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 192/378] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:59 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:39:59.620071 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cdabc29a-dfdd-4572-86b9-360b7fbb5c54 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:39:59.627926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-cdabc29a-dfdd-4572-86b9-360b7fbb5c54 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.156753 Jun 22 18:39:59.628496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 187/379] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:39:59 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:00.304622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-77871781-3ca1-4b19-b5d5-a6b738681709 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:00.305216 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-77871781-3ca1-4b19-b5d5-a6b738681709 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:00.311245 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-77871781-3ca1-4b19-b5d5-a6b738681709 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:00.311678 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-77871781-3ca1-4b19-b5d5-a6b738681709 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:00.312697 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-77871781-3ca1-4b19-b5d5-a6b738681709 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:00.313118 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-77871781-3ca1-4b19-b5d5-a6b738681709 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:00.372629 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-77871781-3ca1-4b19-b5d5-a6b738681709 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:00.380269 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-77871781-3ca1-4b19-b5d5-a6b738681709 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1275 microversion: 2.1 time: 0.079432 Jun 22 18:40:00.380816 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 193/380] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:00 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1275 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:00.522369 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ca6d8d25-86b4-484e-b67e-0f34c9e523e5 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:00.522974 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ca6d8d25-86b4-484e-b67e-0f34c9e523e5 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:00.529401 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca6d8d25-86b4-484e-b67e-0f34c9e523e5 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:00.529843 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca6d8d25-86b4-484e-b67e-0f34c9e523e5 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:00.530606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca6d8d25-86b4-484e-b67e-0f34c9e523e5 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:00.532207 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca6d8d25-86b4-484e-b67e-0f34c9e523e5 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:00.646175 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-de56612d-7f8e-4a75-b47d-fe82ec376c83 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:00.646844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-de56612d-7f8e-4a75-b47d-fe82ec376c83 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:00.653031 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-de56612d-7f8e-4a75-b47d-fe82ec376c83 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:00.653475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-de56612d-7f8e-4a75-b47d-fe82ec376c83 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:00.654426 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-de56612d-7f8e-4a75-b47d-fe82ec376c83 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:00.654863 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-de56612d-7f8e-4a75-b47d-fe82ec376c83 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:00.664218 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ca6d8d25-86b4-484e-b67e-0f34c9e523e5 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:00.671665 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ca6d8d25-86b4-484e-b67e-0f34c9e523e5 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.153031 Jun 22 18:40:00.672549 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 188/381] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:00 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:00.782354 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-de56612d-7f8e-4a75-b47d-fe82ec376c83 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:00.789979 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-de56612d-7f8e-4a75-b47d-fe82ec376c83 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.147642 Jun 22 18:40:00.790638 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 194/382] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:00 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:01.397351 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-9c481bca-17cd-49e2-ac3f-711d3d4a1e05 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:01.397953 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-9c481bca-17cd-49e2-ac3f-711d3d4a1e05 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:01.404749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9c481bca-17cd-49e2-ac3f-711d3d4a1e05 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:01.405203 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9c481bca-17cd-49e2-ac3f-711d3d4a1e05 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:01.406632 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9c481bca-17cd-49e2-ac3f-711d3d4a1e05 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:01.407058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9c481bca-17cd-49e2-ac3f-711d3d4a1e05 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:01.497084 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-9c481bca-17cd-49e2-ac3f-711d3d4a1e05 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:01.505417 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-9c481bca-17cd-49e2-ac3f-711d3d4a1e05 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1275 microversion: 2.1 time: 0.111709 Jun 22 18:40:01.506343 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 189/383] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:01 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:01.688832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-317a4794-5ea6-4545-adac-b1b82e171b87 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:01.689384 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-317a4794-5ea6-4545-adac-b1b82e171b87 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:01.695428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-317a4794-5ea6-4545-adac-b1b82e171b87 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:01.695902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-317a4794-5ea6-4545-adac-b1b82e171b87 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:01.696695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-317a4794-5ea6-4545-adac-b1b82e171b87 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:01.697125 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-317a4794-5ea6-4545-adac-b1b82e171b87 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:01.806554 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3041f65c-afd4-4dc0-9c29-d753058d1955 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:01.807175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3041f65c-afd4-4dc0-9c29-d753058d1955 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:01.814389 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3041f65c-afd4-4dc0-9c29-d753058d1955 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:01.814840 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3041f65c-afd4-4dc0-9c29-d753058d1955 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:01.815796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3041f65c-afd4-4dc0-9c29-d753058d1955 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:01.816270 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3041f65c-afd4-4dc0-9c29-d753058d1955 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:01.825799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-317a4794-5ea6-4545-adac-b1b82e171b87 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:01.834951 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-317a4794-5ea6-4545-adac-b1b82e171b87 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1313 microversion: 2.1 time: 0.149943 Jun 22 18:40:01.834951 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 195/384] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:01 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:01.945943 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3041f65c-afd4-4dc0-9c29-d753058d1955 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:01.953909 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3041f65c-afd4-4dc0-9c29-d753058d1955 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.151305 Jun 22 18:40:01.954452 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 190/385] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:01 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:02.524207 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d753075d-6beb-41f6-8a02-0a23f4f3f013 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:02.524803 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d753075d-6beb-41f6-8a02-0a23f4f3f013 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:02.531367 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d753075d-6beb-41f6-8a02-0a23f4f3f013 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:02.531935 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d753075d-6beb-41f6-8a02-0a23f4f3f013 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:02.532691 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d753075d-6beb-41f6-8a02-0a23f4f3f013 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:02.533157 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d753075d-6beb-41f6-8a02-0a23f4f3f013 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:02.621673 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d753075d-6beb-41f6-8a02-0a23f4f3f013 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:02.632711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d753075d-6beb-41f6-8a02-0a23f4f3f013 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1285 microversion: 2.1 time: 0.110442 Jun 22 18:40:02.636481 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 196/386] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:02 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:02.850347 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-79075ea1-956e-4ca5-b07f-85c15969875c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:02.850949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-79075ea1-956e-4ca5-b07f-85c15969875c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:02.858522 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-79075ea1-956e-4ca5-b07f-85c15969875c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:02.859427 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-79075ea1-956e-4ca5-b07f-85c15969875c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:02.860230 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-79075ea1-956e-4ca5-b07f-85c15969875c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:02.860657 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-79075ea1-956e-4ca5-b07f-85c15969875c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:02.970690 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-37c14e4d-ff59-44e3-a47b-e019a731fca0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:02.971298 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-37c14e4d-ff59-44e3-a47b-e019a731fca0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:02.977669 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-37c14e4d-ff59-44e3-a47b-e019a731fca0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:02.978339 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-37c14e4d-ff59-44e3-a47b-e019a731fca0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:02.979137 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-37c14e4d-ff59-44e3-a47b-e019a731fca0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:02.979755 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-37c14e4d-ff59-44e3-a47b-e019a731fca0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:03.010425 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-79075ea1-956e-4ca5-b07f-85c15969875c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:03.021415 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-79075ea1-956e-4ca5-b07f-85c15969875c tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1496 microversion: 2.1 time: 0.174608 Jun 22 18:40:03.022004 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 191/387] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:02 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1496 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:03.159046 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-37c14e4d-ff59-44e3-a47b-e019a731fca0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:03.168832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-37c14e4d-ff59-44e3-a47b-e019a731fca0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.202574 Jun 22 18:40:03.169495 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 197/388] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:02 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:03.652682 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-861d5058-f2e7-4f31-89ae-7baeacdf40d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:03.653925 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-861d5058-f2e7-4f31-89ae-7baeacdf40d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:03.660012 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-861d5058-f2e7-4f31-89ae-7baeacdf40d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:03.660639 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-861d5058-f2e7-4f31-89ae-7baeacdf40d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:03.661562 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-861d5058-f2e7-4f31-89ae-7baeacdf40d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:03.661991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-861d5058-f2e7-4f31-89ae-7baeacdf40d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:03.741891 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-861d5058-f2e7-4f31-89ae-7baeacdf40d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:03.761890 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-861d5058-f2e7-4f31-89ae-7baeacdf40d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1273 microversion: 2.1 time: 0.112733 Jun 22 18:40:03.762598 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 192/389] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:03 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:03.766951 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6ba7757b-dd91-48b5-8831-a34f42eaeaa7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:03.767703 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6ba7757b-dd91-48b5-8831-a34f42eaeaa7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:03.776235 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6ba7757b-dd91-48b5-8831-a34f42eaeaa7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:03.776838 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6ba7757b-dd91-48b5-8831-a34f42eaeaa7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:03.777606 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6ba7757b-dd91-48b5-8831-a34f42eaeaa7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:03.778067 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6ba7757b-dd91-48b5-8831-a34f42eaeaa7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:03.805320 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6ba7757b-dd91-48b5-8831-a34f42eaeaa7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Going to try to terminate instance {{(pid=129744) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:40:03.894145 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6ba7757b-dd91-48b5-8831-a34f42eaeaa7 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 204 len: 0 microversion: 2.1 time: 0.131878 Jun 22 18:40:03.894753 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 198/390] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:40:03 2022] DELETE /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:40:03.903175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-fbd884dc-8fbe-484c-be22-442ba97ab615 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:03.903784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-fbd884dc-8fbe-484c-be22-442ba97ab615 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:03.910822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fbd884dc-8fbe-484c-be22-442ba97ab615 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:03.911270 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fbd884dc-8fbe-484c-be22-442ba97ab615 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:03.912065 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fbd884dc-8fbe-484c-be22-442ba97ab615 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:03.912499 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fbd884dc-8fbe-484c-be22-442ba97ab615 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:04.085001 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-fbd884dc-8fbe-484c-be22-442ba97ab615 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:04.093873 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-fbd884dc-8fbe-484c-be22-442ba97ab615 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1553 microversion: 2.1 time: 0.194377 Jun 22 18:40:04.094527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 193/391] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:03 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:04.185778 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3f1c0b20-9d2a-403e-8063-5b8316a535e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:04.186466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3f1c0b20-9d2a-403e-8063-5b8316a535e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:04.192544 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3f1c0b20-9d2a-403e-8063-5b8316a535e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:04.192980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3f1c0b20-9d2a-403e-8063-5b8316a535e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:04.193740 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3f1c0b20-9d2a-403e-8063-5b8316a535e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:04.194170 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3f1c0b20-9d2a-403e-8063-5b8316a535e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:04.323143 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3f1c0b20-9d2a-403e-8063-5b8316a535e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:04.331275 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3f1c0b20-9d2a-403e-8063-5b8316a535e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.149751 Jun 22 18:40:04.331865 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 199/392] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:04 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:04.779793 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2a3659df-232e-4f12-b2ca-e7fd4ea6cf9b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:04.780439 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2a3659df-232e-4f12-b2ca-e7fd4ea6cf9b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:04.787458 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2a3659df-232e-4f12-b2ca-e7fd4ea6cf9b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:04.788317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2a3659df-232e-4f12-b2ca-e7fd4ea6cf9b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:04.789096 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2a3659df-232e-4f12-b2ca-e7fd4ea6cf9b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:04.789529 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2a3659df-232e-4f12-b2ca-e7fd4ea6cf9b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:04.923722 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2a3659df-232e-4f12-b2ca-e7fd4ea6cf9b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:04.931502 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2a3659df-232e-4f12-b2ca-e7fd4ea6cf9b tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.155612 Jun 22 18:40:04.932190 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 194/393] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:04 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:05.116721 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8de3c1b7-ff09-4a97-8ad7-44086f6da8a1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:05.116721 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8de3c1b7-ff09-4a97-8ad7-44086f6da8a1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:05.119603 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8de3c1b7-ff09-4a97-8ad7-44086f6da8a1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:05.120090 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8de3c1b7-ff09-4a97-8ad7-44086f6da8a1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:05.120989 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8de3c1b7-ff09-4a97-8ad7-44086f6da8a1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:05.121428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8de3c1b7-ff09-4a97-8ad7-44086f6da8a1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:05.266713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8de3c1b7-ff09-4a97-8ad7-44086f6da8a1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:05.274768 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8de3c1b7-ff09-4a97-8ad7-44086f6da8a1 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1553 microversion: 2.1 time: 0.167178 Jun 22 18:40:05.275429 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 200/394] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:05 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:05.348940 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-67b9a8da-6517-4af5-a51f-3b29fc34e7e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:05.352396 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-67b9a8da-6517-4af5-a51f-3b29fc34e7e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:05.355637 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-67b9a8da-6517-4af5-a51f-3b29fc34e7e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:05.356123 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-67b9a8da-6517-4af5-a51f-3b29fc34e7e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:05.356904 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-67b9a8da-6517-4af5-a51f-3b29fc34e7e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:05.357336 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-67b9a8da-6517-4af5-a51f-3b29fc34e7e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:05.490822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-67b9a8da-6517-4af5-a51f-3b29fc34e7e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:05.498337 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-67b9a8da-6517-4af5-a51f-3b29fc34e7e2 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.153713 Jun 22 18:40:05.498889 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 195/395] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:05 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:05.948862 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8d34103b-aeed-47a2-beb3-3401fb610859 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:05.949457 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8d34103b-aeed-47a2-beb3-3401fb610859 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:05.955607 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8d34103b-aeed-47a2-beb3-3401fb610859 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:05.956081 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8d34103b-aeed-47a2-beb3-3401fb610859 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:05.956831 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8d34103b-aeed-47a2-beb3-3401fb610859 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:05.957253 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8d34103b-aeed-47a2-beb3-3401fb610859 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:06.081567 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8d34103b-aeed-47a2-beb3-3401fb610859 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:06.088899 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8d34103b-aeed-47a2-beb3-3401fb610859 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.143885 Jun 22 18:40:06.089447 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 201/396] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:05 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:06.292751 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-0de376fb-535d-4b1e-a296-55050d8b2425 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:06.293287 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0de376fb-535d-4b1e-a296-55050d8b2425 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:06.300287 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0de376fb-535d-4b1e-a296-55050d8b2425 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:06.300735 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0de376fb-535d-4b1e-a296-55050d8b2425 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:06.301532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0de376fb-535d-4b1e-a296-55050d8b2425 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:06.301966 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0de376fb-535d-4b1e-a296-55050d8b2425 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:06.465999 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-0de376fb-535d-4b1e-a296-55050d8b2425 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:06.474602 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-0de376fb-535d-4b1e-a296-55050d8b2425 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1553 microversion: 2.1 time: 0.185746 Jun 22 18:40:06.475162 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 196/397] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:06 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:06.516617 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-36070985-0a67-4234-b150-33c36003691a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:06.517221 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-36070985-0a67-4234-b150-33c36003691a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:06.523264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-36070985-0a67-4234-b150-33c36003691a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:06.523711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-36070985-0a67-4234-b150-33c36003691a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:06.524511 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-36070985-0a67-4234-b150-33c36003691a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:06.524942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-36070985-0a67-4234-b150-33c36003691a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:06.528946 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:06.657231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-36070985-0a67-4234-b150-33c36003691a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:06.664705 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-36070985-0a67-4234-b150-33c36003691a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.152673 Jun 22 18:40:06.665261 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 202/398] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:06 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:07.106442 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-14154ceb-976a-461f-98ac-5a3536fe0009 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:07.107046 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-14154ceb-976a-461f-98ac-5a3536fe0009 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:07.113730 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-14154ceb-976a-461f-98ac-5a3536fe0009 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:07.114171 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-14154ceb-976a-461f-98ac-5a3536fe0009 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:07.114917 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-14154ceb-976a-461f-98ac-5a3536fe0009 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:07.115344 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-14154ceb-976a-461f-98ac-5a3536fe0009 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:07.246067 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-14154ceb-976a-461f-98ac-5a3536fe0009 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:07.253922 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-14154ceb-976a-461f-98ac-5a3536fe0009 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.151360 Jun 22 18:40:07.254474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 197/399] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:07 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:07.491481 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5697627c-fbe3-4a4b-8599-8fe3def34be9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:07.492068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5697627c-fbe3-4a4b-8599-8fe3def34be9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:07.498115 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5697627c-fbe3-4a4b-8599-8fe3def34be9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:07.498558 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5697627c-fbe3-4a4b-8599-8fe3def34be9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:07.499374 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5697627c-fbe3-4a4b-8599-8fe3def34be9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:07.499859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5697627c-fbe3-4a4b-8599-8fe3def34be9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:07.625290 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5697627c-fbe3-4a4b-8599-8fe3def34be9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:07.633612 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5697627c-fbe3-4a4b-8599-8fe3def34be9 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1553 microversion: 2.1 time: 0.146011 Jun 22 18:40:07.634170 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 203/400] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:07 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:07.680819 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7dd33456-e476-4e27-9bdc-bfaf853b5836 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:07.681461 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7dd33456-e476-4e27-9bdc-bfaf853b5836 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:07.688711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7dd33456-e476-4e27-9bdc-bfaf853b5836 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:07.689158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7dd33456-e476-4e27-9bdc-bfaf853b5836 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:07.689928 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7dd33456-e476-4e27-9bdc-bfaf853b5836 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:07.690365 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7dd33456-e476-4e27-9bdc-bfaf853b5836 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:07.848081 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7dd33456-e476-4e27-9bdc-bfaf853b5836 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:07.855394 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7dd33456-e476-4e27-9bdc-bfaf853b5836 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.178513 Jun 22 18:40:07.855971 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 198/401] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:07 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:08.270544 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d96044db-ddb7-49f8-a1c6-267812491baa tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:08.271143 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d96044db-ddb7-49f8-a1c6-267812491baa tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:08.277511 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d96044db-ddb7-49f8-a1c6-267812491baa tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:08.278213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d96044db-ddb7-49f8-a1c6-267812491baa tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:08.279081 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d96044db-ddb7-49f8-a1c6-267812491baa tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:08.279584 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d96044db-ddb7-49f8-a1c6-267812491baa tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:08.388207 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-ab9f62e0-586d-4821-b789-22c40fe599f7 req-cb3180f9-455f-4934-a419-86bd95a901e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d2858c-1136-4d33-bafd-72671874819f", "tag": "e9f7d927-2770-4d1b-8584-41ef244559ab"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:08.396682 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-ab9f62e0-586d-4821-b789-22c40fe599f7 req-cb3180f9-455f-4934-a419-86bd95a901e3 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:08.397381 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-ab9f62e0-586d-4821-b789-22c40fe599f7 req-cb3180f9-455f-4934-a419-86bd95a901e3 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:08.416143 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-ab9f62e0-586d-4821-b789-22c40fe599f7 req-cb3180f9-455f-4934-a419-86bd95a901e3 service nova] Creating event network-changed:e9f7d927-2770-4d1b-8584-41ef244559ab for instance e7d2858c-1136-4d33-bafd-72671874819f on hv-cinder-81268 Jun 22 18:40:08.423261 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-ab9f62e0-586d-4821-b789-22c40fe599f7 req-cb3180f9-455f-4934-a419-86bd95a901e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039465 Jun 22 18:40:08.424285 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 199/402] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:40:08.424407 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d96044db-ddb7-49f8-a1c6-267812491baa tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:08.433074 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d96044db-ddb7-49f8-a1c6-267812491baa tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.166190 Jun 22 18:40:08.433847 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 204/403] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:08 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:08.650965 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-61ee8f4a-9f96-49e5-8cd5-633ea3ad286e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:08.651583 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-61ee8f4a-9f96-49e5-8cd5-633ea3ad286e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:08.658498 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-61ee8f4a-9f96-49e5-8cd5-633ea3ad286e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:08.658946 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-61ee8f4a-9f96-49e5-8cd5-633ea3ad286e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:08.659713 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-61ee8f4a-9f96-49e5-8cd5-633ea3ad286e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:08.660187 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-61ee8f4a-9f96-49e5-8cd5-633ea3ad286e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:08.664300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:08.797390 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-61ee8f4a-9f96-49e5-8cd5-633ea3ad286e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:08.805479 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-61ee8f4a-9f96-49e5-8cd5-633ea3ad286e tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1553 microversion: 2.1 time: 0.158673 Jun 22 18:40:08.806184 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 200/404] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:08 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:08.864160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-db182260-2d2a-4571-97dc-c211dedcab13 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:08.864698 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-db182260-2d2a-4571-97dc-c211dedcab13 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:08.870723 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-db182260-2d2a-4571-97dc-c211dedcab13 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:08.871187 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-db182260-2d2a-4571-97dc-c211dedcab13 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:08.872008 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-db182260-2d2a-4571-97dc-c211dedcab13 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:08.872111 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-dbf397c6-8d78-42d8-bee2-13f65c792889 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:08.872445 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-db182260-2d2a-4571-97dc-c211dedcab13 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:08.872618 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-dbf397c6-8d78-42d8-bee2-13f65c792889 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:08.879288 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dbf397c6-8d78-42d8-bee2-13f65c792889 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:08.879731 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dbf397c6-8d78-42d8-bee2-13f65c792889 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:08.880608 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dbf397c6-8d78-42d8-bee2-13f65c792889 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:08.881039 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dbf397c6-8d78-42d8-bee2-13f65c792889 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:08.898943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-db182260-2d2a-4571-97dc-c211dedcab13 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Going to try to terminate instance {{(pid=129744) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:40:08.981965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-db182260-2d2a-4571-97dc-c211dedcab13 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "DELETE /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 204 len: 0 microversion: 2.1 time: 0.122744 Jun 22 18:40:08.982548 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 205/405] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:40:08 2022] DELETE /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:40:08.991600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-00c98fd4-07b7-407f-8660-1422ad999dd3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:08.992312 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-00c98fd4-07b7-407f-8660-1422ad999dd3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:08.998117 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-00c98fd4-07b7-407f-8660-1422ad999dd3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:08.998559 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-00c98fd4-07b7-407f-8660-1422ad999dd3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:08.999938 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-00c98fd4-07b7-407f-8660-1422ad999dd3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:09.000372 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-00c98fd4-07b7-407f-8660-1422ad999dd3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:09.018194 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-dbf397c6-8d78-42d8-bee2-13f65c792889 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:09.025643 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-dbf397c6-8d78-42d8-bee2-13f65c792889 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.157557 Jun 22 18:40:09.026207 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 201/406] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:08 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:09.130951 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-00c98fd4-07b7-407f-8660-1422ad999dd3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:09.139169 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-00c98fd4-07b7-407f-8660-1422ad999dd3 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1502 microversion: 2.1 time: 0.151674 Jun 22 18:40:09.139740 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 206/407] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:08 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:09.450378 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2136ff8a-0b4c-4c0e-95b0-d4030f25ec84 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:09.450985 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2136ff8a-0b4c-4c0e-95b0-d4030f25ec84 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:09.458022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2136ff8a-0b4c-4c0e-95b0-d4030f25ec84 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:09.458463 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2136ff8a-0b4c-4c0e-95b0-d4030f25ec84 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:09.459238 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2136ff8a-0b4c-4c0e-95b0-d4030f25ec84 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:09.459671 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2136ff8a-0b4c-4c0e-95b0-d4030f25ec84 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:09.817161 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2136ff8a-0b4c-4c0e-95b0-d4030f25ec84 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:09.822724 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4bccd322-b5b4-43d4-a74f-68d6201dfe91 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:09.826252 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4bccd322-b5b4-43d4-a74f-68d6201dfe91 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:09.837420 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2136ff8a-0b4c-4c0e-95b0-d4030f25ec84 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.390850 Jun 22 18:40:09.837999 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 202/408] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:09 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:09.842558 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4bccd322-b5b4-43d4-a74f-68d6201dfe91 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:09.842715 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4bccd322-b5b4-43d4-a74f-68d6201dfe91 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:09.846578 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4bccd322-b5b4-43d4-a74f-68d6201dfe91 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:09.850335 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4bccd322-b5b4-43d4-a74f-68d6201dfe91 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:10.001244 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4bccd322-b5b4-43d4-a74f-68d6201dfe91 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:10.013560 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4bccd322-b5b4-43d4-a74f-68d6201dfe91 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1553 microversion: 2.1 time: 0.194523 Jun 22 18:40:10.014150 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 207/409] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:09 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:10.045062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5ad39b21-feab-4cf5-b4b3-2c1e75e797a5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:10.045742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5ad39b21-feab-4cf5-b4b3-2c1e75e797a5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:10.051808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5ad39b21-feab-4cf5-b4b3-2c1e75e797a5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:10.052365 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5ad39b21-feab-4cf5-b4b3-2c1e75e797a5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:10.053207 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5ad39b21-feab-4cf5-b4b3-2c1e75e797a5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:10.053683 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5ad39b21-feab-4cf5-b4b3-2c1e75e797a5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:10.157733 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7ab3846b-cba0-40ff-a882-b351fba4672a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:10.158580 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7ab3846b-cba0-40ff-a882-b351fba4672a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:10.165425 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ab3846b-cba0-40ff-a882-b351fba4672a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:10.166213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ab3846b-cba0-40ff-a882-b351fba4672a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:10.167147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ab3846b-cba0-40ff-a882-b351fba4672a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:10.167586 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ab3846b-cba0-40ff-a882-b351fba4672a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:10.190578 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5ad39b21-feab-4cf5-b4b3-2c1e75e797a5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:10.198347 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5ad39b21-feab-4cf5-b4b3-2c1e75e797a5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.157048 Jun 22 18:40:10.225299 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 203/410] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:10 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:10.350418 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7ab3846b-cba0-40ff-a882-b351fba4672a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:10.362723 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7ab3846b-cba0-40ff-a882-b351fba4672a tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1502 microversion: 2.1 time: 0.209627 Jun 22 18:40:10.363997 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 208/411] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:10 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:10.853209 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d47dddb2-167e-4907-a1dc-a6c9b7925265 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:10.853822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d47dddb2-167e-4907-a1dc-a6c9b7925265 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:10.860448 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d47dddb2-167e-4907-a1dc-a6c9b7925265 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:10.860929 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d47dddb2-167e-4907-a1dc-a6c9b7925265 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:10.861698 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d47dddb2-167e-4907-a1dc-a6c9b7925265 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:10.862284 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d47dddb2-167e-4907-a1dc-a6c9b7925265 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:10.993942 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d47dddb2-167e-4907-a1dc-a6c9b7925265 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:11.003297 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d47dddb2-167e-4907-a1dc-a6c9b7925265 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.153443 Jun 22 18:40:11.004414 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 204/412] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:10 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:11.031015 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e8eb4212-00fe-487b-b93d-f00cb2d2c04c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:11.031691 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e8eb4212-00fe-487b-b93d-f00cb2d2c04c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:11.038719 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e8eb4212-00fe-487b-b93d-f00cb2d2c04c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:11.039173 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e8eb4212-00fe-487b-b93d-f00cb2d2c04c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:11.039976 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e8eb4212-00fe-487b-b93d-f00cb2d2c04c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:11.040419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e8eb4212-00fe-487b-b93d-f00cb2d2c04c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:11.183409 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e8eb4212-00fe-487b-b93d-f00cb2d2c04c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:11.191764 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e8eb4212-00fe-487b-b93d-f00cb2d2c04c tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1553 microversion: 2.1 time: 0.164839 Jun 22 18:40:11.192362 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 209/413] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:11 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:11.216445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-8776ec3c-fc11-405f-989b-56e3436d9aa8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:11.217175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-8776ec3c-fc11-405f-989b-56e3436d9aa8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:11.224258 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8776ec3c-fc11-405f-989b-56e3436d9aa8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:11.224954 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8776ec3c-fc11-405f-989b-56e3436d9aa8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:11.225887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8776ec3c-fc11-405f-989b-56e3436d9aa8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:11.226370 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8776ec3c-fc11-405f-989b-56e3436d9aa8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:11.382297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-859d7835-fe9f-4290-b7cc-3286a10f89e8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:11.383137 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-859d7835-fe9f-4290-b7cc-3286a10f89e8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:11.391815 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-859d7835-fe9f-4290-b7cc-3286a10f89e8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:11.392419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-859d7835-fe9f-4290-b7cc-3286a10f89e8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:11.394200 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-859d7835-fe9f-4290-b7cc-3286a10f89e8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:11.394740 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-859d7835-fe9f-4290-b7cc-3286a10f89e8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:11.484400 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-8776ec3c-fc11-405f-989b-56e3436d9aa8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:11.497211 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-8776ec3c-fc11-405f-989b-56e3436d9aa8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.284186 Jun 22 18:40:11.510516 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 205/414] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:11 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:11.572556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-859d7835-fe9f-4290-b7cc-3286a10f89e8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:11.581117 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-859d7835-fe9f-4290-b7cc-3286a10f89e8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1502 microversion: 2.1 time: 0.204206 Jun 22 18:40:11.581887 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 210/415] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:11 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:12.023327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bb8ca1bb-c296-437f-ba48-53621cbd99c2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:12.024148 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bb8ca1bb-c296-437f-ba48-53621cbd99c2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:12.031432 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bb8ca1bb-c296-437f-ba48-53621cbd99c2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:12.032109 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bb8ca1bb-c296-437f-ba48-53621cbd99c2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:12.033202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bb8ca1bb-c296-437f-ba48-53621cbd99c2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:12.033712 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bb8ca1bb-c296-437f-ba48-53621cbd99c2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:12.210292 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-390e070b-1dbb-4a2c-a865-a218e7b73d36 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:12.210921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-390e070b-1dbb-4a2c-a865-a218e7b73d36 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:12.218679 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-390e070b-1dbb-4a2c-a865-a218e7b73d36 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:12.219339 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-390e070b-1dbb-4a2c-a865-a218e7b73d36 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:12.220152 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-390e070b-1dbb-4a2c-a865-a218e7b73d36 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:12.221185 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-390e070b-1dbb-4a2c-a865-a218e7b73d36 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:12.372166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bb8ca1bb-c296-437f-ba48-53621cbd99c2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:12.385138 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bb8ca1bb-c296-437f-ba48-53621cbd99c2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.366241 Jun 22 18:40:12.387524 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 206/416] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:12 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:12.400139 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-390e070b-1dbb-4a2c-a865-a218e7b73d36 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:12.411230 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-390e070b-1dbb-4a2c-a865-a218e7b73d36 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1553 microversion: 2.1 time: 0.206321 Jun 22 18:40:12.413017 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 211/417] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:12 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:12.515285 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ccbaa93a-195f-4364-8096-c5c7fefc68bf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:12.515931 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ccbaa93a-195f-4364-8096-c5c7fefc68bf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:12.524594 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ccbaa93a-195f-4364-8096-c5c7fefc68bf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:12.525350 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ccbaa93a-195f-4364-8096-c5c7fefc68bf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:12.526354 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ccbaa93a-195f-4364-8096-c5c7fefc68bf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:12.526948 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ccbaa93a-195f-4364-8096-c5c7fefc68bf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:12.567508 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-fb81c330-dc54-4268-b0b0-c987c690bab3 req-fb1cd61d-aaf5-4e4a-b31c-ea02f75707cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10bda053-aa92-4811-ae79-e5ed926c5860", "name": "network-vif-deleted", "tag": "a0636fe7-12f6-4d9e-8831-3d1efe728a6c"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:12.577606 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-fb81c330-dc54-4268-b0b0-c987c690bab3 req-fb1cd61d-aaf5-4e4a-b31c-ea02f75707cf service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:12.578779 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-fb81c330-dc54-4268-b0b0-c987c690bab3 req-fb1cd61d-aaf5-4e4a-b31c-ea02f75707cf service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:12.593414 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-fb81c330-dc54-4268-b0b0-c987c690bab3 req-fb1cd61d-aaf5-4e4a-b31c-ea02f75707cf service nova] Creating event network-vif-deleted:a0636fe7-12f6-4d9e-8831-3d1efe728a6c for instance 10bda053-aa92-4811-ae79-e5ed926c5860 on hv-cinder-81268 Jun 22 18:40:12.599199 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-fb81c330-dc54-4268-b0b0-c987c690bab3 req-fb1cd61d-aaf5-4e4a-b31c-ea02f75707cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039433 Jun 22 18:40:12.600197 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 212/418] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:40:12.606101 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8181fb11-95b2-4b1e-870a-55603126bb79 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:12.606939 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8181fb11-95b2-4b1e-870a-55603126bb79 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:12.617783 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8181fb11-95b2-4b1e-870a-55603126bb79 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:12.618525 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8181fb11-95b2-4b1e-870a-55603126bb79 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:12.619483 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8181fb11-95b2-4b1e-870a-55603126bb79 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:12.620299 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8181fb11-95b2-4b1e-870a-55603126bb79 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:12.716774 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8181fb11-95b2-4b1e-870a-55603126bb79 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:12.725544 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8181fb11-95b2-4b1e-870a-55603126bb79 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1460 microversion: 2.1 time: 0.123886 Jun 22 18:40:12.726184 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 213/419] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:12 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1460 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:12.784472 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ccbaa93a-195f-4364-8096-c5c7fefc68bf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:12.792089 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ccbaa93a-195f-4364-8096-c5c7fefc68bf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.280912 Jun 22 18:40:12.792908 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 207/420] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:12 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:13.406781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-85bb080f-02ac-4546-b04a-76695050c00d tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:13.407633 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-85bb080f-02ac-4546-b04a-76695050c00d tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:13.415793 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-85bb080f-02ac-4546-b04a-76695050c00d tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:13.416356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-85bb080f-02ac-4546-b04a-76695050c00d tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:13.417151 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-85bb080f-02ac-4546-b04a-76695050c00d tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:13.417589 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-85bb080f-02ac-4546-b04a-76695050c00d tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:13.429372 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1cd1efeb-20d6-433f-a5b2-4aba09b5f410 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:13.429997 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1cd1efeb-20d6-433f-a5b2-4aba09b5f410 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:13.436637 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1cd1efeb-20d6-433f-a5b2-4aba09b5f410 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:13.437655 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1cd1efeb-20d6-433f-a5b2-4aba09b5f410 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:13.438428 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1cd1efeb-20d6-433f-a5b2-4aba09b5f410 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:13.438869 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1cd1efeb-20d6-433f-a5b2-4aba09b5f410 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:13.501655 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1cd1efeb-20d6-433f-a5b2-4aba09b5f410 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:13.510020 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1cd1efeb-20d6-433f-a5b2-4aba09b5f410 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1511 microversion: 2.1 time: 0.084535 Jun 22 18:40:13.510588 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 208/421] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:13 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:13.554107 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-85bb080f-02ac-4546-b04a-76695050c00d tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:13.561622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-85bb080f-02ac-4546-b04a-76695050c00d tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.160302 Jun 22 18:40:13.562287 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 214/422] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:13 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:13.742728 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-89e7bf30-68ca-4c12-8008-72cbe36f8609 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:13.743484 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-89e7bf30-68ca-4c12-8008-72cbe36f8609 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:13.751599 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-89e7bf30-68ca-4c12-8008-72cbe36f8609 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:13.752126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-89e7bf30-68ca-4c12-8008-72cbe36f8609 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:13.753841 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-89e7bf30-68ca-4c12-8008-72cbe36f8609 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:13.754492 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-89e7bf30-68ca-4c12-8008-72cbe36f8609 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:13.811282 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-487b598e-23fe-418f-a5af-6bfa4e2445cc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:13.812062 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-487b598e-23fe-418f-a5af-6bfa4e2445cc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:13.818858 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-487b598e-23fe-418f-a5af-6bfa4e2445cc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:13.819364 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-487b598e-23fe-418f-a5af-6bfa4e2445cc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:13.820182 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-487b598e-23fe-418f-a5af-6bfa4e2445cc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:13.820601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-487b598e-23fe-418f-a5af-6bfa4e2445cc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:13.882782 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-89e7bf30-68ca-4c12-8008-72cbe36f8609 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:13.893931 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-89e7bf30-68ca-4c12-8008-72cbe36f8609 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 200 len: 1298 microversion: 2.1 time: 0.155204 Jun 22 18:40:13.903955 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 209/423] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:13 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 1298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:13.977232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-487b598e-23fe-418f-a5af-6bfa4e2445cc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:13.985254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-487b598e-23fe-418f-a5af-6bfa4e2445cc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.179442 Jun 22 18:40:13.985857 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 215/424] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:13 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:14.526825 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5bd966a7-8237-476f-9ad1-4a1192e93e93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:14.527454 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5bd966a7-8237-476f-9ad1-4a1192e93e93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:14.534287 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5bd966a7-8237-476f-9ad1-4a1192e93e93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:14.534752 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5bd966a7-8237-476f-9ad1-4a1192e93e93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:14.536068 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5bd966a7-8237-476f-9ad1-4a1192e93e93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:14.536658 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5bd966a7-8237-476f-9ad1-4a1192e93e93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:14.569061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5bd966a7-8237-476f-9ad1-4a1192e93e93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:14.569505 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5bd966a7-8237-476f-9ad1-4a1192e93e93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:14.569958 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.objects.instance [None req-5bd966a7-8237-476f-9ad1-4a1192e93e93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lazy-loading 'fault' on Instance uuid ab156cb7-09be-4142-be86-0adbd49ae23f {{(pid=129743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:40:14.579524 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-26452033-00e3-4809-b059-385b91df12b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:14.580165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-26452033-00e3-4809-b059-385b91df12b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:14.586723 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26452033-00e3-4809-b059-385b91df12b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:14.587171 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26452033-00e3-4809-b059-385b91df12b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:14.588646 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26452033-00e3-4809-b059-385b91df12b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:14.589293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26452033-00e3-4809-b059-385b91df12b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:14.638780 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5bd966a7-8237-476f-9ad1-4a1192e93e93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:14.648396 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5bd966a7-8237-476f-9ad1-4a1192e93e93 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1351 microversion: 2.1 time: 0.125606 Jun 22 18:40:14.649120 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 210/425] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:14 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:14.657623 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-f79d617f-a2d9-467a-b14b-54688b512cb6 req-6671adf5-fd51-43e7-8c48-5588c1cec446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab156cb7-09be-4142-be86-0adbd49ae23f", "name": "network-vif-deleted", "tag": "17ef6483-b512-4263-89ff-3669960db87f"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:14.666886 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-f79d617f-a2d9-467a-b14b-54688b512cb6 req-6671adf5-fd51-43e7-8c48-5588c1cec446 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:14.667334 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-f79d617f-a2d9-467a-b14b-54688b512cb6 req-6671adf5-fd51-43e7-8c48-5588c1cec446 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:14.681162 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-f79d617f-a2d9-467a-b14b-54688b512cb6 req-6671adf5-fd51-43e7-8c48-5588c1cec446 service nova] Creating event network-vif-deleted:17ef6483-b512-4263-89ff-3669960db87f for instance ab156cb7-09be-4142-be86-0adbd49ae23f on hv-cinder-81268 Jun 22 18:40:14.686255 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-f79d617f-a2d9-467a-b14b-54688b512cb6 req-6671adf5-fd51-43e7-8c48-5588c1cec446 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035110 Jun 22 18:40:14.687262 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 211/426] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:40:14.731397 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-26452033-00e3-4809-b059-385b91df12b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:14.739963 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-26452033-00e3-4809-b059-385b91df12b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.165308 Jun 22 18:40:14.750260 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 216/427] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:14 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:14.912509 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-614db20a-79f5-4d79-9d12-fef958fedba0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:14.913204 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-614db20a-79f5-4d79-9d12-fef958fedba0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: 10bda053-aa92-4811-ae79-e5ed926c5860] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:14.919886 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-614db20a-79f5-4d79-9d12-fef958fedba0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:14.920343 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-614db20a-79f5-4d79-9d12-fef958fedba0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:14.921859 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-614db20a-79f5-4d79-9d12-fef958fedba0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:14.922317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-614db20a-79f5-4d79-9d12-fef958fedba0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:14.936009 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-614db20a-79f5-4d79-9d12-fef958fedba0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] HTTP exception thrown: Instance 10bda053-aa92-4811-ae79-e5ed926c5860 could not be found. Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-614db20a-79f5-4d79-9d12-fef958fedba0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Request method failure captured: Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 HTTP/1.1 Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2HI5_c8q9UP5dPC3iU-IXN1q0lXt9OQWJaf2wfxEz2VI4QQnUnBWWT3hv6ZOjgu1ycuAwLwGTgkwofgFC7Was8C7OBkV3U4wmYR1NtOBkQeHy4alSI0SxY-lXMjZxPiDLKVgGJG-6Uq5XDxGff_Rjj3jS8-CvXHz-J6vEbSPFCVuH4 Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: ffb5e6607fb843bca3fb4a6ae694d47e Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-VolumesActionsTest-1138445335 Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:40:14.940551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:40:14.942023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ffb5e6607fb843bca3fb4a6ae694d47e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ffb5e6607fb843bca3fb4a6ae694d47e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ffb5e6607fb843bca3fb4a6ae694d47e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ffb5e6607fb843bca3fb4a6ae694d47e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:40:14.942023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-VolumesActionsTest-1138445335 Jun 22 18:40:14.942023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: ffb5e6607fb843bca3fb4a6ae694d47e Jun 22 18:40:14.942023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-VolumesActionsTest-1138445335 Jun 22 18:40:14.942023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-VolumesActionsTest-1138445335-project Jun 22 18:40:14.942023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:40:14.942023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:40:14.942023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: e671d76c5e5b4d528310abedb603d16d Jun 22 18:40:14.942023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-VolumesActionsTest-1138445335-project Jun 22 18:40:14.942023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:40:14.942023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 10bda053-aa92-4811-ae79-e5ed926c5860 could not be found. Jun 22 18:40:14.942023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '10bda053-aa92-4811-ae79-e5ed926c5860'} Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10bda053-aa92-4811-ae79-e5ed926c5860 could not be found. Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:40:14.946784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10bda053-aa92-4811-ae79-e5ed926c5860 could not be found. Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10bda053-aa92-4811-ae79-e5ed926c5860 could not be found. Jun 22 18:40:14.948144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:14.949310 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-614db20a-79f5-4d79-9d12-fef958fedba0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Returning 404 to user: Instance 10bda053-aa92-4811-ae79-e5ed926c5860 could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:40:14.949310 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-614db20a-79f5-4d79-9d12-fef958fedba0 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860" status: 404 len: 111 microversion: 2.1 time: 0.033808 Jun 22 18:40:14.949310 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 212/428] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:14 2022] GET /compute/v2.1/servers/10bda053-aa92-4811-ae79-e5ed926c5860 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:40:15.003089 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3e155711-5622-4a83-b756-b7444c10df24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:15.004018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3e155711-5622-4a83-b756-b7444c10df24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:15.010819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3e155711-5622-4a83-b756-b7444c10df24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:15.011269 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3e155711-5622-4a83-b756-b7444c10df24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:15.012259 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3e155711-5622-4a83-b756-b7444c10df24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:15.013321 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3e155711-5622-4a83-b756-b7444c10df24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:15.062028 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1085603598", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "networks": [{"uuid": "a77cb063-35a2-4e3d-ae37-3ec6bbaffdb8"}]}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:15.114389 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.network.neutron [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] validate_networks() for [('a77cb063-35a2-4e3d-ae37-3ec6bbaffdb8', None, None, None, None, None)] {{(pid=129743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:40:15.194609 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3e155711-5622-4a83-b756-b7444c10df24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:15.198668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:15.205522 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3e155711-5622-4a83-b756-b7444c10df24 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.206696 Jun 22 18:40:15.206399 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 217/429] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:14 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:15.495363 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Flavor limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:40:15.495774 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Image limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:40:15.496289 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Flavor pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:40:15.496681 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Image pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:40:15.497496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:40:15.509697 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:15.510140 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:15.510938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:15.511557 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:15.536504 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Getting quotas for project ffb5e6607fb843bca3fb4a6ae694d47e. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:40:15.540680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Getting quotas for user e671d76c5e5b4d528310abedb603d16d and project ffb5e6607fb843bca3fb4a6ae694d47e. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:40:15.553179 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Going to run 1 instances... {{(pid=129743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:40:15.555429 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:40:15.576470 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:15.605608 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b07e67b0-c0ae-47a1-a2a5-b2a4795119d4 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547979 Jun 22 18:40:15.606481 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 213/430] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:40:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 18:40:15.618247 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cd5eda50-44c1-4050-9909-b9e6b851e677 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:15.618885 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cd5eda50-44c1-4050-9909-b9e6b851e677 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:15.626766 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:15.666867 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-326eb011-03e5-4f79-9049-a411d8ef6704 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:15.667821 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-326eb011-03e5-4f79-9049-a411d8ef6704 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:15.678043 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-326eb011-03e5-4f79-9049-a411d8ef6704 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:15.679430 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-326eb011-03e5-4f79-9049-a411d8ef6704 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:15.680431 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-326eb011-03e5-4f79-9049-a411d8ef6704 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:15.681064 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-326eb011-03e5-4f79-9049-a411d8ef6704 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:15.726063 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-326eb011-03e5-4f79-9049-a411d8ef6704 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:15.727743 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-326eb011-03e5-4f79-9049-a411d8ef6704 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:15.728970 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.objects.instance [None req-326eb011-03e5-4f79-9049-a411d8ef6704 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lazy-loading 'fault' on Instance uuid ab156cb7-09be-4142-be86-0adbd49ae23f {{(pid=129743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:40:15.754067 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cd5eda50-44c1-4050-9909-b9e6b851e677 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:15.762328 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cd5eda50-44c1-4050-9909-b9e6b851e677 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1214 microversion: 2.1 time: 0.148797 Jun 22 18:40:15.765831 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 218/431] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:15 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:15.774428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9ff28545-58a9-4429-a979-fa0a45ffaa5e tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:15.777055 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9ff28545-58a9-4429-a979-fa0a45ffaa5e tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:15.791621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9ff28545-58a9-4429-a979-fa0a45ffaa5e tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:15.793340 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9ff28545-58a9-4429-a979-fa0a45ffaa5e tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:15.795247 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9ff28545-58a9-4429-a979-fa0a45ffaa5e tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:15.800563 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9ff28545-58a9-4429-a979-fa0a45ffaa5e tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:15.809329 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-326eb011-03e5-4f79-9049-a411d8ef6704 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:15.820762 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-326eb011-03e5-4f79-9049-a411d8ef6704 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1351 microversion: 2.1 time: 0.158183 Jun 22 18:40:15.822060 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 214/432] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:15 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1351 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:16.177741 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9ff28545-58a9-4429-a979-fa0a45ffaa5e tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:16.191867 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9ff28545-58a9-4429-a979-fa0a45ffaa5e tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.424835 Jun 22 18:40:16.192507 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 219/433] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:15 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:16.224785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-75d37ec2-a343-46d2-9b13-a6926bd5534d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:16.225760 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-75d37ec2-a343-46d2-9b13-a6926bd5534d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:16.238621 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75d37ec2-a343-46d2-9b13-a6926bd5534d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:16.240342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75d37ec2-a343-46d2-9b13-a6926bd5534d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:16.241297 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75d37ec2-a343-46d2-9b13-a6926bd5534d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:16.244362 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75d37ec2-a343-46d2-9b13-a6926bd5534d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:16.431971 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-75d37ec2-a343-46d2-9b13-a6926bd5534d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:16.440006 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-75d37ec2-a343-46d2-9b13-a6926bd5534d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.220856 Jun 22 18:40:16.440568 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 215/434] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:16 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:16.781785 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7649b75e-5364-4a41-9cfe-27b607d3c152 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:16.782337 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7649b75e-5364-4a41-9cfe-27b607d3c152 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:16.788655 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7649b75e-5364-4a41-9cfe-27b607d3c152 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:16.789094 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7649b75e-5364-4a41-9cfe-27b607d3c152 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:16.789862 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7649b75e-5364-4a41-9cfe-27b607d3c152 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:16.790454 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7649b75e-5364-4a41-9cfe-27b607d3c152 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:16.840161 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-896dc4d3-8411-43cf-9933-5fc41a04a43f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:16.840964 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-896dc4d3-8411-43cf-9933-5fc41a04a43f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:16.848466 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-896dc4d3-8411-43cf-9933-5fc41a04a43f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:16.849048 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-896dc4d3-8411-43cf-9933-5fc41a04a43f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:16.849931 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-896dc4d3-8411-43cf-9933-5fc41a04a43f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:16.850489 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-896dc4d3-8411-43cf-9933-5fc41a04a43f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:16.891767 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-896dc4d3-8411-43cf-9933-5fc41a04a43f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:16.892284 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-896dc4d3-8411-43cf-9933-5fc41a04a43f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:16.892733 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.objects.instance [None req-896dc4d3-8411-43cf-9933-5fc41a04a43f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lazy-loading 'fault' on Instance uuid ab156cb7-09be-4142-be86-0adbd49ae23f {{(pid=129743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:40:16.918516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7649b75e-5364-4a41-9cfe-27b607d3c152 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:16.930729 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7649b75e-5364-4a41-9cfe-27b607d3c152 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1218 microversion: 2.1 time: 0.153337 Jun 22 18:40:16.931769 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 220/435] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:16 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1218 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:16.942286 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-896dc4d3-8411-43cf-9933-5fc41a04a43f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eae8de1576148ed83eaf66da7971818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c31a31afc94f8688241b713ec3e892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:16.952227 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-896dc4d3-8411-43cf-9933-5fc41a04a43f tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 200 len: 1351 microversion: 2.1 time: 0.117666 Jun 22 18:40:16.956242 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 216/436] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:16 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 1351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:17.208612 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5f232104-1542-48f8-918b-7dbca809bcf3 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:17.209203 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5f232104-1542-48f8-918b-7dbca809bcf3 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:17.215660 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5f232104-1542-48f8-918b-7dbca809bcf3 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:17.216149 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5f232104-1542-48f8-918b-7dbca809bcf3 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:17.217291 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5f232104-1542-48f8-918b-7dbca809bcf3 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:17.217291 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5f232104-1542-48f8-918b-7dbca809bcf3 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:17.405489 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5f232104-1542-48f8-918b-7dbca809bcf3 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:17.415327 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5f232104-1542-48f8-918b-7dbca809bcf3 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.210414 Jun 22 18:40:17.416305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 221/437] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:17 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:17.457865 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-953a9bc8-aa31-4989-8561-8de2693d625f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:17.458774 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-953a9bc8-aa31-4989-8561-8de2693d625f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:17.465563 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-953a9bc8-aa31-4989-8561-8de2693d625f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:17.466237 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-953a9bc8-aa31-4989-8561-8de2693d625f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:17.467175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-953a9bc8-aa31-4989-8561-8de2693d625f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:17.468274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-953a9bc8-aa31-4989-8561-8de2693d625f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:17.774226 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-953a9bc8-aa31-4989-8561-8de2693d625f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:17.779393 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:17.788476 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-953a9bc8-aa31-4989-8561-8de2693d625f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1521 microversion: 2.1 time: 0.334570 Jun 22 18:40:17.789285 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 217/438] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:17 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:17.949532 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6f82594f-9bf6-49ce-b30c-339b270b8664 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:17.950818 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6f82594f-9bf6-49ce-b30c-339b270b8664 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:17.958867 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6f82594f-9bf6-49ce-b30c-339b270b8664 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:17.960252 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6f82594f-9bf6-49ce-b30c-339b270b8664 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:17.961205 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6f82594f-9bf6-49ce-b30c-339b270b8664 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:17.962309 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6f82594f-9bf6-49ce-b30c-339b270b8664 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:17.971335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-085d6128-309c-4246-9a22-6e8ee0ecebb3 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:17.972616 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-085d6128-309c-4246-9a22-6e8ee0ecebb3 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:17.985976 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-085d6128-309c-4246-9a22-6e8ee0ecebb3 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:17.986433 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-085d6128-309c-4246-9a22-6e8ee0ecebb3 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:17.987227 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-085d6128-309c-4246-9a22-6e8ee0ecebb3 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:17.987659 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-085d6128-309c-4246-9a22-6e8ee0ecebb3 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:18.026947 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-085d6128-309c-4246-9a22-6e8ee0ecebb3 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] HTTP exception thrown: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-085d6128-309c-4246-9a22-6e8ee0ecebb3 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Request method failure captured: Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f HTTP/1.1 Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GK4GENw0ZKaQastHcGhN37kdhfWJQ2s0MkCv7H3gOHr5DtBzEVW01zxx7ezHeBpH-73L8KqU8HuxdbbqG5Utvr3Qhr5s_0ewiAnOFdaX3jq7DChHZSlbyss14B20-eXFlbzqpr4RNI4bHw9yaHmHZ0FlrpFkNW8jAIeQFn0ZUDjPQ Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 61c31a31afc94f8688241b713ec3e892 Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-DeleteServersTestJSON-442635268 Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:40:18.028961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:40:18.030404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_61c31a31afc94f8688241b713ec3e892", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/61c31a31afc94f8688241b713ec3e892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61c31a31afc94f8688241b713ec3e892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61c31a31afc94f8688241b713ec3e892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:40:18.030404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-DeleteServersTestJSON-442635268 Jun 22 18:40:18.030404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 61c31a31afc94f8688241b713ec3e892 Jun 22 18:40:18.030404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-DeleteServersTestJSON-442635268 Jun 22 18:40:18.030404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-DeleteServersTestJSON-442635268-project Jun 22 18:40:18.030404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:40:18.030404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:40:18.030404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 3eae8de1576148ed83eaf66da7971818 Jun 22 18:40:18.030404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-DeleteServersTestJSON-442635268-project Jun 22 18:40:18.030404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:40:18.030404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:18.030404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': 'ab156cb7-09be-4142-be86-0adbd49ae23f'} Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:40:18.031220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:18.032437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:18.033368 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-085d6128-309c-4246-9a22-6e8ee0ecebb3 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Returning 404 to user: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:40:18.033368 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-085d6128-309c-4246-9a22-6e8ee0ecebb3 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 404 len: 111 microversion: 2.1 time: 0.064422 Jun 22 18:40:18.033368 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 218/439] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:17 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 18:40:18.120192 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6f82594f-9bf6-49ce-b30c-339b270b8664 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:18.144992 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6f82594f-9bf6-49ce-b30c-339b270b8664 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1266 microversion: 2.1 time: 0.200010 Jun 22 18:40:18.147684 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 222/440] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:17 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:18.165853 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ffe38680-875a-45cb-a513-379c314abe8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:18.167740 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ffe38680-875a-45cb-a513-379c314abe8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:18.175977 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ffe38680-875a-45cb-a513-379c314abe8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:18.176699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ffe38680-875a-45cb-a513-379c314abe8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:18.177695 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ffe38680-875a-45cb-a513-379c314abe8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:18.178541 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ffe38680-875a-45cb-a513-379c314abe8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:18.199112 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-ffe38680-875a-45cb-a513-379c314abe8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] HTTP exception thrown: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ffe38680-875a-45cb-a513-379c314abe8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Request method failure captured: Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f/os-volume_attachments HTTP/1.1 Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GK4GENw0ZKaQastHcGhN37kdhfWJQ2s0MkCv7H3gOHr5DtBzEVW01zxx7ezHeBpH-73L8KqU8HuxdbbqG5Utvr3Qhr5s_0ewiAnOFdaX3jq7DChHZSlbyss14B20-eXFlbzqpr4RNI4bHw9yaHmHZ0FlrpFkNW8jAIeQFn0ZUDjPQ Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 61c31a31afc94f8688241b713ec3e892 Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-DeleteServersTestJSON-442635268 Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:40:18.201913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:40:18.203473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_61c31a31afc94f8688241b713ec3e892", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/61c31a31afc94f8688241b713ec3e892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61c31a31afc94f8688241b713ec3e892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61c31a31afc94f8688241b713ec3e892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:40:18.203473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-DeleteServersTestJSON-442635268 Jun 22 18:40:18.203473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 61c31a31afc94f8688241b713ec3e892 Jun 22 18:40:18.203473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-DeleteServersTestJSON-442635268 Jun 22 18:40:18.203473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-DeleteServersTestJSON-442635268-project Jun 22 18:40:18.203473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:40:18.203473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:40:18.203473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 3eae8de1576148ed83eaf66da7971818 Jun 22 18:40:18.203473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-DeleteServersTestJSON-442635268-project Jun 22 18:40:18.203473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:40:18.203473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:18.203473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'server_id': 'ab156cb7-09be-4142-be86-0adbd49ae23f'} Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:40:18.204387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:18.205547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:18.206604 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ffe38680-875a-45cb-a513-379c314abe8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Returning 404 to user: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:40:18.206604 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ffe38680-875a-45cb-a513-379c314abe8d tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042956 Jun 22 18:40:18.206604 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 219/441] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:40:18 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:40:18.456188 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9914f6e7-f717-4086-a8a3-030d96b88d91 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:18.458090 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9914f6e7-f717-4086-a8a3-030d96b88d91 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:18.471989 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9914f6e7-f717-4086-a8a3-030d96b88d91 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:18.472693 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9914f6e7-f717-4086-a8a3-030d96b88d91 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:18.474217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9914f6e7-f717-4086-a8a3-030d96b88d91 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:18.474835 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9914f6e7-f717-4086-a8a3-030d96b88d91 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:18.655472 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9914f6e7-f717-4086-a8a3-030d96b88d91 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:18.664878 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9914f6e7-f717-4086-a8a3-030d96b88d91 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.234903 Jun 22 18:40:18.675482 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 223/442] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:18 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:18.810062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-dbfc8b8a-385b-4476-a691-712f186c4189 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:18.810682 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-dbfc8b8a-385b-4476-a691-712f186c4189 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:18.825563 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dbfc8b8a-385b-4476-a691-712f186c4189 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:18.826087 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dbfc8b8a-385b-4476-a691-712f186c4189 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:18.827469 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dbfc8b8a-385b-4476-a691-712f186c4189 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:18.828278 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dbfc8b8a-385b-4476-a691-712f186c4189 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:19.166603 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e4fdb9e9-1b9c-4db8-9702-bd3ba787b62d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:19.167097 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-dbfc8b8a-385b-4476-a691-712f186c4189 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:19.167467 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e4fdb9e9-1b9c-4db8-9702-bd3ba787b62d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:19.174088 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e4fdb9e9-1b9c-4db8-9702-bd3ba787b62d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:19.174651 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e4fdb9e9-1b9c-4db8-9702-bd3ba787b62d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:19.174785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-dbfc8b8a-385b-4476-a691-712f186c4189 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1501 microversion: 2.1 time: 0.369069 Jun 22 18:40:19.175229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 220/443] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:18 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1501 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:19.180146 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e4fdb9e9-1b9c-4db8-9702-bd3ba787b62d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:19.180146 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e4fdb9e9-1b9c-4db8-9702-bd3ba787b62d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:19.192352 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ca2b1e8a-a192-4a93-8842-98c9d07593c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:19.193054 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ca2b1e8a-a192-4a93-8842-98c9d07593c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:19.206182 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca2b1e8a-a192-4a93-8842-98c9d07593c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:19.206630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca2b1e8a-a192-4a93-8842-98c9d07593c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:19.207409 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca2b1e8a-a192-4a93-8842-98c9d07593c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:19.207894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca2b1e8a-a192-4a93-8842-98c9d07593c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:19.275813 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e4fdb9e9-1b9c-4db8-9702-bd3ba787b62d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:19.285408 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e4fdb9e9-1b9c-4db8-9702-bd3ba787b62d tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1272 microversion: 2.1 time: 0.122034 Jun 22 18:40:19.294867 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 224/444] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:19 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:19.504433 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ca2b1e8a-a192-4a93-8842-98c9d07593c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:19.515050 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ca2b1e8a-a192-4a93-8842-98c9d07593c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1515 microversion: 2.1 time: 0.327391 Jun 22 18:40:19.515809 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 221/445] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:19 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1515 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:19.543587 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5788ca58-3166-46b4-9af1-e47a422f675a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:19.544367 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5788ca58-3166-46b4-9af1-e47a422f675a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:19.564087 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5788ca58-3166-46b4-9af1-e47a422f675a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:19.564563 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5788ca58-3166-46b4-9af1-e47a422f675a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:19.567436 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5788ca58-3166-46b4-9af1-e47a422f675a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:19.567997 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5788ca58-3166-46b4-9af1-e47a422f675a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:19.582562 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-5788ca58-3166-46b4-9af1-e47a422f675a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] HTTP exception thrown: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5788ca58-3166-46b4-9af1-e47a422f675a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Request method failure captured: Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: DELETE /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f HTTP/1.1 Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2GK4GENw0ZKaQastHcGhN37kdhfWJQ2s0MkCv7H3gOHr5DtBzEVW01zxx7ezHeBpH-73L8KqU8HuxdbbqG5Utvr3Qhr5s_0ewiAnOFdaX3jq7DChHZSlbyss14B20-eXFlbzqpr4RNI4bHw9yaHmHZ0FlrpFkNW8jAIeQFn0ZUDjPQ Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 61c31a31afc94f8688241b713ec3e892 Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-DeleteServersTestJSON-442635268 Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:40:19.587140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:40:19.588588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_61c31a31afc94f8688241b713ec3e892", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/61c31a31afc94f8688241b713ec3e892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61c31a31afc94f8688241b713ec3e892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61c31a31afc94f8688241b713ec3e892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:40:19.588588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-DeleteServersTestJSON-442635268 Jun 22 18:40:19.588588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 61c31a31afc94f8688241b713ec3e892 Jun 22 18:40:19.588588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-DeleteServersTestJSON-442635268 Jun 22 18:40:19.588588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-DeleteServersTestJSON-442635268-project Jun 22 18:40:19.588588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:40:19.588588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:40:19.588588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 3eae8de1576148ed83eaf66da7971818 Jun 22 18:40:19.588588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-DeleteServersTestJSON-442635268-project Jun 22 18:40:19.588588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:40:19.588588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:19.588588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': 'ab156cb7-09be-4142-be86-0adbd49ae23f'} Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:40:19.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:19.590637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:19.593126 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5788ca58-3166-46b4-9af1-e47a422f675a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Returning 404 to user: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:40:19.594344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5788ca58-3166-46b4-9af1-e47a422f675a tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 404 len: 111 microversion: 2.1 time: 0.055542 Jun 22 18:40:19.595492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 225/446] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:40:19 2022] DELETE /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:40:19.607004 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-25fd7c54-cc0d-4531-b8ab-9227d6bd1d72 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:19.609084 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-25fd7c54-cc0d-4531-b8ab-9227d6bd1d72 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] [instance: ab156cb7-09be-4142-be86-0adbd49ae23f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:19.619649 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-25fd7c54-cc0d-4531-b8ab-9227d6bd1d72 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:19.620121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-25fd7c54-cc0d-4531-b8ab-9227d6bd1d72 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:19.620889 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-25fd7c54-cc0d-4531-b8ab-9227d6bd1d72 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:19.621316 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-25fd7c54-cc0d-4531-b8ab-9227d6bd1d72 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:19.638427 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-25fd7c54-cc0d-4531-b8ab-9227d6bd1d72 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] HTTP exception thrown: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-25fd7c54-cc0d-4531-b8ab-9227d6bd1d72 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Request method failure captured: Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f HTTP/1.1 Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GK4GENw0ZKaQastHcGhN37kdhfWJQ2s0MkCv7H3gOHr5DtBzEVW01zxx7ezHeBpH-73L8KqU8HuxdbbqG5Utvr3Qhr5s_0ewiAnOFdaX3jq7DChHZSlbyss14B20-eXFlbzqpr4RNI4bHw9yaHmHZ0FlrpFkNW8jAIeQFn0ZUDjPQ Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 61c31a31afc94f8688241b713ec3e892 Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-DeleteServersTestJSON-442635268 Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:40:19.640445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:40:19.642022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_61c31a31afc94f8688241b713ec3e892", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/61c31a31afc94f8688241b713ec3e892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61c31a31afc94f8688241b713ec3e892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61c31a31afc94f8688241b713ec3e892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:40:19.642022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-DeleteServersTestJSON-442635268 Jun 22 18:40:19.642022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 61c31a31afc94f8688241b713ec3e892 Jun 22 18:40:19.642022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-DeleteServersTestJSON-442635268 Jun 22 18:40:19.642022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-DeleteServersTestJSON-442635268-project Jun 22 18:40:19.642022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:40:19.642022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:40:19.642022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 3eae8de1576148ed83eaf66da7971818 Jun 22 18:40:19.642022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-DeleteServersTestJSON-442635268-project Jun 22 18:40:19.642022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:40:19.642022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:19.642022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': 'ab156cb7-09be-4142-be86-0adbd49ae23f'} Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:40:19.642729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. Jun 22 18:40:19.643773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:40:19.644857 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-25fd7c54-cc0d-4531-b8ab-9227d6bd1d72 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] Returning 404 to user: Instance ab156cb7-09be-4142-be86-0adbd49ae23f could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:40:19.644857 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-25fd7c54-cc0d-4531-b8ab-9227d6bd1d72 tempest-DeleteServersTestJSON-442635268 tempest-DeleteServersTestJSON-442635268-project] 10.222.0.18 "GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f" status: 404 len: 111 microversion: 2.1 time: 0.042774 Jun 22 18:40:19.644857 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 222/447] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:19 2022] GET /compute/v2.1/servers/ab156cb7-09be-4142-be86-0adbd49ae23f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:40:19.682376 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a925501e-7a5c-4555-9429-9e6bc5d20e83 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:19.682982 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a925501e-7a5c-4555-9429-9e6bc5d20e83 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:19.695421 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a925501e-7a5c-4555-9429-9e6bc5d20e83 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:19.695982 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a925501e-7a5c-4555-9429-9e6bc5d20e83 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:19.696780 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a925501e-7a5c-4555-9429-9e6bc5d20e83 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:19.697212 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a925501e-7a5c-4555-9429-9e6bc5d20e83 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:20.041621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a925501e-7a5c-4555-9429-9e6bc5d20e83 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:20.054165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a925501e-7a5c-4555-9429-9e6bc5d20e83 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.374465 Jun 22 18:40:20.056385 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 226/448] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:19 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:20.304256 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b38a9f3a-7ed6-4554-b835-6b73709f8e92 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:20.304992 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b38a9f3a-7ed6-4554-b835-6b73709f8e92 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:20.321343 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b38a9f3a-7ed6-4554-b835-6b73709f8e92 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:20.323367 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b38a9f3a-7ed6-4554-b835-6b73709f8e92 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:20.326049 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b38a9f3a-7ed6-4554-b835-6b73709f8e92 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:20.330391 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b38a9f3a-7ed6-4554-b835-6b73709f8e92 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:20.553997 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b38a9f3a-7ed6-4554-b835-6b73709f8e92 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:20.566450 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b38a9f3a-7ed6-4554-b835-6b73709f8e92 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1272 microversion: 2.1 time: 0.267556 Jun 22 18:40:20.579976 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 223/449] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:20 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:20.732242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-522d17db-96d6-45cc-8467-c1ecadb2c278 req-27c2ba7c-4808-4bef-874f-60034c8004aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d2858c-1136-4d33-bafd-72671874819f", "name": "network-vif-plugged", "status": "completed", "tag": "e9f7d927-2770-4d1b-8584-41ef244559ab"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:20.758902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-522d17db-96d6-45cc-8467-c1ecadb2c278 req-27c2ba7c-4808-4bef-874f-60034c8004aa service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:20.759582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-522d17db-96d6-45cc-8467-c1ecadb2c278 req-27c2ba7c-4808-4bef-874f-60034c8004aa service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:20.793330 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-522d17db-96d6-45cc-8467-c1ecadb2c278 req-27c2ba7c-4808-4bef-874f-60034c8004aa service nova] Creating event network-vif-plugged:e9f7d927-2770-4d1b-8584-41ef244559ab for instance e7d2858c-1136-4d33-bafd-72671874819f on hv-cinder-81268 Jun 22 18:40:20.807277 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-522d17db-96d6-45cc-8467-c1ecadb2c278 req-27c2ba7c-4808-4bef-874f-60034c8004aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077701 Jun 22 18:40:20.808167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 227/450] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:40:21.072411 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-466a0bd7-0edc-410b-a19b-6494c6d8e5df tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:21.073315 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-466a0bd7-0edc-410b-a19b-6494c6d8e5df tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:21.080414 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-466a0bd7-0edc-410b-a19b-6494c6d8e5df tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:21.081061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-466a0bd7-0edc-410b-a19b-6494c6d8e5df tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:21.081995 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-466a0bd7-0edc-410b-a19b-6494c6d8e5df tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:21.082570 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-466a0bd7-0edc-410b-a19b-6494c6d8e5df tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:21.323534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-119d2a5e-7109-47dd-81e0-ca294df9c578 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:21.324598 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-119d2a5e-7109-47dd-81e0-ca294df9c578 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:21.348820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-119d2a5e-7109-47dd-81e0-ca294df9c578 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:21.352084 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-119d2a5e-7109-47dd-81e0-ca294df9c578 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:21.353393 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-119d2a5e-7109-47dd-81e0-ca294df9c578 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:21.353836 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-119d2a5e-7109-47dd-81e0-ca294df9c578 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:21.403543 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-119d2a5e-7109-47dd-81e0-ca294df9c578 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lazy-loading 'flavor' on Instance uuid 66481d9b-408f-4891-8b17-76fface18ff4 {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:40:21.454866 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-466a0bd7-0edc-410b-a19b-6494c6d8e5df tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:21.466951 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-466a0bd7-0edc-410b-a19b-6494c6d8e5df tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.398580 Jun 22 18:40:21.467605 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 224/451] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:21 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:21.582830 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-94c0c595-f766-4d3c-a1f9-118da511d6df tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:21.583791 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-94c0c595-f766-4d3c-a1f9-118da511d6df tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:21.602274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94c0c595-f766-4d3c-a1f9-118da511d6df tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:21.602724 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94c0c595-f766-4d3c-a1f9-118da511d6df tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:21.603530 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94c0c595-f766-4d3c-a1f9-118da511d6df tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:21.603984 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94c0c595-f766-4d3c-a1f9-118da511d6df tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:21.608736 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-119d2a5e-7109-47dd-81e0-ca294df9c578 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "POST /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4/action" status: 200 len: 32 microversion: 2.1 time: 0.291789 Jun 22 18:40:21.609747 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 228/452] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:40:21 2022] POST /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4/action => generated 32 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 18:40:21.622592 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-817fdb25-263c-4b82-9424-a32f268e73f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:21.625612 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-817fdb25-263c-4b82-9424-a32f268e73f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:21.647782 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-817fdb25-263c-4b82-9424-a32f268e73f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:21.660308 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-817fdb25-263c-4b82-9424-a32f268e73f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:21.661637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-817fdb25-263c-4b82-9424-a32f268e73f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:21.662325 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-817fdb25-263c-4b82-9424-a32f268e73f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:21.928720 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-817fdb25-263c-4b82-9424-a32f268e73f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:21.938799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-817fdb25-263c-4b82-9424-a32f268e73f4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.324119 Jun 22 18:40:21.939528 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 229/453] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:21 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:22.221190 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-94c0c595-f766-4d3c-a1f9-118da511d6df tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:22.231267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-94c0c595-f766-4d3c-a1f9-118da511d6df tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.652131 Jun 22 18:40:22.234332 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 225/454] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:21 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:22.486339 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1c52f0a0-57e1-4c98-a840-055d153df6d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:22.487118 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-1c52f0a0-57e1-4c98-a840-055d153df6d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:22.498301 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1c52f0a0-57e1-4c98-a840-055d153df6d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:22.503120 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1c52f0a0-57e1-4c98-a840-055d153df6d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:22.506273 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1c52f0a0-57e1-4c98-a840-055d153df6d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:22.506849 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1c52f0a0-57e1-4c98-a840-055d153df6d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:22.890028 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-1c52f0a0-57e1-4c98-a840-055d153df6d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:22.898207 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-1c52f0a0-57e1-4c98-a840-055d153df6d6 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1315 microversion: 2.1 time: 0.417093 Jun 22 18:40:22.903258 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 230/455] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:22 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:22.957017 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-8890f51b-19ce-4559-bfde-7d4d7f029767 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:22.957652 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-8890f51b-19ce-4559-bfde-7d4d7f029767 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:22.973581 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8890f51b-19ce-4559-bfde-7d4d7f029767 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:22.974430 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8890f51b-19ce-4559-bfde-7d4d7f029767 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:22.981017 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8890f51b-19ce-4559-bfde-7d4d7f029767 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:22.982038 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8890f51b-19ce-4559-bfde-7d4d7f029767 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:23.251032 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-801da664-47f6-4a82-9ed7-9cb2316fbacb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:23.252469 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-801da664-47f6-4a82-9ed7-9cb2316fbacb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:23.261059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-801da664-47f6-4a82-9ed7-9cb2316fbacb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:23.268117 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-801da664-47f6-4a82-9ed7-9cb2316fbacb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:23.269173 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-801da664-47f6-4a82-9ed7-9cb2316fbacb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:23.269771 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-801da664-47f6-4a82-9ed7-9cb2316fbacb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:23.614897 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-8890f51b-19ce-4559-bfde-7d4d7f029767 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:23.624308 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-8890f51b-19ce-4559-bfde-7d4d7f029767 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.671259 Jun 22 18:40:23.625213 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 226/456] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:22 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:23.650894 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-801da664-47f6-4a82-9ed7-9cb2316fbacb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:23.659487 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-801da664-47f6-4a82-9ed7-9cb2316fbacb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.412562 Jun 22 18:40:23.665576 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 231/457] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:23 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:23.920572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b2b71e76-3350-405c-9ce1-8b8b32add0f1 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:23.921284 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b2b71e76-3350-405c-9ce1-8b8b32add0f1 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:23.928086 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b2b71e76-3350-405c-9ce1-8b8b32add0f1 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:23.928915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b2b71e76-3350-405c-9ce1-8b8b32add0f1 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:23.929961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b2b71e76-3350-405c-9ce1-8b8b32add0f1 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:23.930498 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b2b71e76-3350-405c-9ce1-8b8b32add0f1 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:24.049152 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-1c2ad3bc-2f0e-4e77-8e4d-5abcb599e855 req-dbc7015b-eb00-453b-a1c5-7738e2d24c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546", "tag": "a8b2a978-3992-4cb5-ad2d-53a5c97675c1"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:24.058608 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-1c2ad3bc-2f0e-4e77-8e4d-5abcb599e855 req-dbc7015b-eb00-453b-a1c5-7738e2d24c38 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:24.059072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-1c2ad3bc-2f0e-4e77-8e4d-5abcb599e855 req-dbc7015b-eb00-453b-a1c5-7738e2d24c38 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:24.094684 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-1c2ad3bc-2f0e-4e77-8e4d-5abcb599e855 req-dbc7015b-eb00-453b-a1c5-7738e2d24c38 service nova] Creating event network-changed:a8b2a978-3992-4cb5-ad2d-53a5c97675c1 for instance fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 on hv-cinder-81268 Jun 22 18:40:24.100909 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-1c2ad3bc-2f0e-4e77-8e4d-5abcb599e855 req-dbc7015b-eb00-453b-a1c5-7738e2d24c38 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055725 Jun 22 18:40:24.104699 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 232/458] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:40:24.643656 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-bc6fb688-f22b-4782-900c-60668cd9649a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:24.645520 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-bc6fb688-f22b-4782-900c-60668cd9649a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:24.653165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bc6fb688-f22b-4782-900c-60668cd9649a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:24.653615 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bc6fb688-f22b-4782-900c-60668cd9649a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:24.655136 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bc6fb688-f22b-4782-900c-60668cd9649a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:24.656705 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bc6fb688-f22b-4782-900c-60668cd9649a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:24.822729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b2b71e76-3350-405c-9ce1-8b8b32add0f1 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:24.850262 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b2b71e76-3350-405c-9ce1-8b8b32add0f1 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1465 microversion: 2.1 time: 0.933463 Jun 22 18:40:24.852178 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 227/459] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:23 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1465 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:24.863910 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c59b3526-a905-4568-a4f0-ef867f8b5b03 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:24.868758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c59b3526-a905-4568-a4f0-ef867f8b5b03 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:24.893099 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c59b3526-a905-4568-a4f0-ef867f8b5b03 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:24.893560 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c59b3526-a905-4568-a4f0-ef867f8b5b03 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:24.894359 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c59b3526-a905-4568-a4f0-ef867f8b5b03 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:24.894803 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c59b3526-a905-4568-a4f0-ef867f8b5b03 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:24.908544 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bc6fb688-f22b-4782-900c-60668cd9649a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:24.917815 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-bc6fb688-f22b-4782-900c-60668cd9649a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.279999 Jun 22 18:40:24.918747 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 233/460] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:24 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:24.928340 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3d9f4ffd-4877-4bd0-84ff-f11045786c0a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:24.929144 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3d9f4ffd-4877-4bd0-84ff-f11045786c0a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:24.937617 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3d9f4ffd-4877-4bd0-84ff-f11045786c0a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:24.938663 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3d9f4ffd-4877-4bd0-84ff-f11045786c0a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:24.940971 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3d9f4ffd-4877-4bd0-84ff-f11045786c0a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:24.941755 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3d9f4ffd-4877-4bd0-84ff-f11045786c0a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:24.990408 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3d9f4ffd-4877-4bd0-84ff-f11045786c0a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Going to try to terminate instance {{(pid=129744) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:40:25.035331 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:25.114496 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3d9f4ffd-4877-4bd0-84ff-f11045786c0a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 204 len: 0 microversion: 2.1 time: 0.191674 Jun 22 18:40:25.115521 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 234/461] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:40:24 2022] DELETE /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:40:25.136802 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d6e8c504-70dc-42ff-858b-659ee93e5e85 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:25.138729 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d6e8c504-70dc-42ff-858b-659ee93e5e85 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:25.144375 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d6e8c504-70dc-42ff-858b-659ee93e5e85 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:25.144818 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d6e8c504-70dc-42ff-858b-659ee93e5e85 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:25.146089 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d6e8c504-70dc-42ff-858b-659ee93e5e85 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:25.146528 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d6e8c504-70dc-42ff-858b-659ee93e5e85 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:25.288791 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d6e8c504-70dc-42ff-858b-659ee93e5e85 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:25.297011 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d6e8c504-70dc-42ff-858b-659ee93e5e85 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1471 microversion: 2.1 time: 0.167334 Jun 22 18:40:25.297695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 235/462] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:25 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:25.380916 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c59b3526-a905-4568-a4f0-ef867f8b5b03 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:25.388997 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c59b3526-a905-4568-a4f0-ef867f8b5b03 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.535592 Jun 22 18:40:25.390051 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 228/463] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:24 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:25.935576 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-087a6518-9d95-4b0b-ac39-56a0eaa86b4f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:25.936727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-087a6518-9d95-4b0b-ac39-56a0eaa86b4f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:25.939495 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:25.954470 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-087a6518-9d95-4b0b-ac39-56a0eaa86b4f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:25.955784 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-087a6518-9d95-4b0b-ac39-56a0eaa86b4f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:25.958639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-087a6518-9d95-4b0b-ac39-56a0eaa86b4f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:25.959567 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-087a6518-9d95-4b0b-ac39-56a0eaa86b4f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:26.249038 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-087a6518-9d95-4b0b-ac39-56a0eaa86b4f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:26.262975 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-087a6518-9d95-4b0b-ac39-56a0eaa86b4f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.332221 Jun 22 18:40:26.264374 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 236/464] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:25 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:26.314841 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6222cd68-e6b8-44ef-a410-a4d19f53bd5c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:26.315676 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6222cd68-e6b8-44ef-a410-a4d19f53bd5c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:26.318591 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:26.319684 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=6 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:26.328991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6222cd68-e6b8-44ef-a410-a4d19f53bd5c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:26.329437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6222cd68-e6b8-44ef-a410-a4d19f53bd5c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:26.338977 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6222cd68-e6b8-44ef-a410-a4d19f53bd5c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:26.339651 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6222cd68-e6b8-44ef-a410-a4d19f53bd5c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:26.408670 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0b0d9d88-83d6-440b-98f9-96867b034720 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:26.409651 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0b0d9d88-83d6-440b-98f9-96867b034720 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:26.427261 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0b0d9d88-83d6-440b-98f9-96867b034720 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:26.428115 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0b0d9d88-83d6-440b-98f9-96867b034720 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:26.430751 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0b0d9d88-83d6-440b-98f9-96867b034720 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:26.432292 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0b0d9d88-83d6-440b-98f9-96867b034720 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:26.776704 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6222cd68-e6b8-44ef-a410-a4d19f53bd5c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:26.789303 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6222cd68-e6b8-44ef-a410-a4d19f53bd5c tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1471 microversion: 2.1 time: 0.478500 Jun 22 18:40:26.797374 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 229/465] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:26 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1471 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:26.937943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0b0d9d88-83d6-440b-98f9-96867b034720 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:26.947125 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0b0d9d88-83d6-440b-98f9-96867b034720 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.542830 Jun 22 18:40:26.950553 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 237/466] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:26 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:27.282120 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-82f506a1-8b16-447b-a65e-8c9a719fa0db tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:27.282753 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-82f506a1-8b16-447b-a65e-8c9a719fa0db tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:27.297343 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-82f506a1-8b16-447b-a65e-8c9a719fa0db tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:27.297904 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-82f506a1-8b16-447b-a65e-8c9a719fa0db tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:27.299577 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-82f506a1-8b16-447b-a65e-8c9a719fa0db tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:27.300289 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-82f506a1-8b16-447b-a65e-8c9a719fa0db tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:27.558265 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-82f506a1-8b16-447b-a65e-8c9a719fa0db tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:27.575793 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-82f506a1-8b16-447b-a65e-8c9a719fa0db tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.297445 Jun 22 18:40:27.578443 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 230/467] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:27 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:27.816945 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-19a30e65-4a6c-400e-92f0-cf653f40fb1a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:27.818009 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-19a30e65-4a6c-400e-92f0-cf653f40fb1a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:27.831692 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-19a30e65-4a6c-400e-92f0-cf653f40fb1a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:27.832582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-19a30e65-4a6c-400e-92f0-cf653f40fb1a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:27.833652 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-19a30e65-4a6c-400e-92f0-cf653f40fb1a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:27.834239 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-19a30e65-4a6c-400e-92f0-cf653f40fb1a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:27.967814 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4dda190f-83b5-44f7-889b-52051aca0269 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:27.968671 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-4dda190f-83b5-44f7-889b-52051aca0269 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:27.977076 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4dda190f-83b5-44f7-889b-52051aca0269 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:27.977829 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4dda190f-83b5-44f7-889b-52051aca0269 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:27.978765 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4dda190f-83b5-44f7-889b-52051aca0269 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:27.979349 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4dda190f-83b5-44f7-889b-52051aca0269 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:28.075027 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-19a30e65-4a6c-400e-92f0-cf653f40fb1a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:28.083650 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-19a30e65-4a6c-400e-92f0-cf653f40fb1a tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1471 microversion: 2.1 time: 0.273969 Jun 22 18:40:28.095737 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 238/468] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:27 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1471 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:28.318223 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4dda190f-83b5-44f7-889b-52051aca0269 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:28.336580 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4dda190f-83b5-44f7-889b-52051aca0269 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.370639 Jun 22 18:40:28.346449 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 231/469] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:27 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:28.595714 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-85565633-6d83-4362-8c9c-6cd70458b4dc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:28.597008 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-85565633-6d83-4362-8c9c-6cd70458b4dc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:28.608755 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-85565633-6d83-4362-8c9c-6cd70458b4dc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:28.616595 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-85565633-6d83-4362-8c9c-6cd70458b4dc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:28.619730 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-85565633-6d83-4362-8c9c-6cd70458b4dc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:28.622141 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-85565633-6d83-4362-8c9c-6cd70458b4dc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:29.046685 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-85565633-6d83-4362-8c9c-6cd70458b4dc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:29.068029 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-85565633-6d83-4362-8c9c-6cd70458b4dc tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.477299 Jun 22 18:40:29.070164 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 239/470] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:28 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:29.102753 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-18b6ce3b-0e69-47a2-b0e0-f91ebc6c36cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:29.103364 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-18b6ce3b-0e69-47a2-b0e0-f91ebc6c36cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:29.121161 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-18b6ce3b-0e69-47a2-b0e0-f91ebc6c36cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:29.121604 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-18b6ce3b-0e69-47a2-b0e0-f91ebc6c36cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:29.122406 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-18b6ce3b-0e69-47a2-b0e0-f91ebc6c36cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:29.123692 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-18b6ce3b-0e69-47a2-b0e0-f91ebc6c36cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:29.354289 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7c7f1915-8a3c-4e97-ae74-629d5c15a69f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:29.354827 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7c7f1915-8a3c-4e97-ae74-629d5c15a69f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:29.361350 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7c7f1915-8a3c-4e97-ae74-629d5c15a69f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:29.361793 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7c7f1915-8a3c-4e97-ae74-629d5c15a69f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:29.362569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7c7f1915-8a3c-4e97-ae74-629d5c15a69f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:29.362984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7c7f1915-8a3c-4e97-ae74-629d5c15a69f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:29.458223 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-18b6ce3b-0e69-47a2-b0e0-f91ebc6c36cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:29.468380 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-18b6ce3b-0e69-47a2-b0e0-f91ebc6c36cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1471 microversion: 2.1 time: 0.369845 Jun 22 18:40:29.476405 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 232/471] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:29 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1471 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:29.508989 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7c7f1915-8a3c-4e97-ae74-629d5c15a69f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:29.518309 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7c7f1915-8a3c-4e97-ae74-629d5c15a69f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.167949 Jun 22 18:40:29.518882 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 240/472] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:29 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:30.088591 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5a95f66f-21b1-4a84-aee4-0949784de2ac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:30.089218 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5a95f66f-21b1-4a84-aee4-0949784de2ac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:30.100833 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a95f66f-21b1-4a84-aee4-0949784de2ac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:30.102340 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a95f66f-21b1-4a84-aee4-0949784de2ac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:30.104403 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a95f66f-21b1-4a84-aee4-0949784de2ac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:30.104955 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a95f66f-21b1-4a84-aee4-0949784de2ac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:30.345926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5a95f66f-21b1-4a84-aee4-0949784de2ac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:30.358720 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5a95f66f-21b1-4a84-aee4-0949784de2ac tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.273442 Jun 22 18:40:30.360787 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 233/473] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:30 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:30.487362 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c27a5b3a-8169-4ebc-b2eb-c3c464c2ee96 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:30.487999 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c27a5b3a-8169-4ebc-b2eb-c3c464c2ee96 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:30.502854 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c27a5b3a-8169-4ebc-b2eb-c3c464c2ee96 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:30.503345 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c27a5b3a-8169-4ebc-b2eb-c3c464c2ee96 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:30.504190 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c27a5b3a-8169-4ebc-b2eb-c3c464c2ee96 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:30.504622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c27a5b3a-8169-4ebc-b2eb-c3c464c2ee96 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:30.535114 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-22dba75a-fafb-4077-8437-7f9c939ffdc1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:30.535864 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-22dba75a-fafb-4077-8437-7f9c939ffdc1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:30.547211 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-22dba75a-fafb-4077-8437-7f9c939ffdc1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:30.547622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-22dba75a-fafb-4077-8437-7f9c939ffdc1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:30.555772 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-22dba75a-fafb-4077-8437-7f9c939ffdc1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:30.556334 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-22dba75a-fafb-4077-8437-7f9c939ffdc1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:30.863330 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-22dba75a-fafb-4077-8437-7f9c939ffdc1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:30.875505 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-22dba75a-fafb-4077-8437-7f9c939ffdc1 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.344389 Jun 22 18:40:30.892256 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 234/474] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:30 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:31.058585 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c27a5b3a-8169-4ebc-b2eb-c3c464c2ee96 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:31.092471 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c27a5b3a-8169-4ebc-b2eb-c3c464c2ee96 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1471 microversion: 2.1 time: 0.608308 Jun 22 18:40:31.094876 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 241/475] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:30 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1471 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:31.380699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2c5b8e0b-faef-41f3-a5ec-fc7b1a38ba60 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:31.382861 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2c5b8e0b-faef-41f3-a5ec-fc7b1a38ba60 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:31.390914 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e0b-faef-41f3-a5ec-fc7b1a38ba60 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:31.391681 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e0b-faef-41f3-a5ec-fc7b1a38ba60 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:31.392834 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e0b-faef-41f3-a5ec-fc7b1a38ba60 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:31.393327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e0b-faef-41f3-a5ec-fc7b1a38ba60 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:31.692257 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2c5b8e0b-faef-41f3-a5ec-fc7b1a38ba60 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:31.714241 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2c5b8e0b-faef-41f3-a5ec-fc7b1a38ba60 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.341192 Jun 22 18:40:31.715471 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 235/476] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:31 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:31.894714 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6df1dde8-f062-4274-878c-66d5adfe323e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:31.897965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6df1dde8-f062-4274-878c-66d5adfe323e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:31.905265 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6df1dde8-f062-4274-878c-66d5adfe323e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:31.905765 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6df1dde8-f062-4274-878c-66d5adfe323e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:31.906831 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6df1dde8-f062-4274-878c-66d5adfe323e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:31.907324 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6df1dde8-f062-4274-878c-66d5adfe323e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:32.115701 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-098c1443-c867-4684-a91f-1f716c82c1b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:32.118218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6df1dde8-f062-4274-878c-66d5adfe323e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:32.118976 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-098c1443-c867-4684-a91f-1f716c82c1b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:32.130576 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6df1dde8-f062-4274-878c-66d5adfe323e tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.240153 Jun 22 18:40:32.143178 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 242/477] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:31 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:32.159787 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-098c1443-c867-4684-a91f-1f716c82c1b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:32.160584 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-098c1443-c867-4684-a91f-1f716c82c1b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:32.161706 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-098c1443-c867-4684-a91f-1f716c82c1b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:32.162424 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-098c1443-c867-4684-a91f-1f716c82c1b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:32.195704 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:32.652905 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-098c1443-c867-4684-a91f-1f716c82c1b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:32.660822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-098c1443-c867-4684-a91f-1f716c82c1b2 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1471 microversion: 2.1 time: 0.553711 Jun 22 18:40:32.673005 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 236/478] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:32 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1471 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:32.730320 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3afe19ee-2907-4619-9ed3-dda9020bbf55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:32.731157 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3afe19ee-2907-4619-9ed3-dda9020bbf55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:32.739535 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3afe19ee-2907-4619-9ed3-dda9020bbf55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:32.745564 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3afe19ee-2907-4619-9ed3-dda9020bbf55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:32.746654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3afe19ee-2907-4619-9ed3-dda9020bbf55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:32.747310 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3afe19ee-2907-4619-9ed3-dda9020bbf55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:33.069654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3afe19ee-2907-4619-9ed3-dda9020bbf55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:33.084118 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3afe19ee-2907-4619-9ed3-dda9020bbf55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.357460 Jun 22 18:40:33.085132 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 243/479] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:32 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:33.160454 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6cccd33c-5acc-4d4b-a021-8f7748206d54 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:33.161194 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6cccd33c-5acc-4d4b-a021-8f7748206d54 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:33.178891 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6cccd33c-5acc-4d4b-a021-8f7748206d54 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:33.183805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6cccd33c-5acc-4d4b-a021-8f7748206d54 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:33.184831 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6cccd33c-5acc-4d4b-a021-8f7748206d54 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:33.185385 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6cccd33c-5acc-4d4b-a021-8f7748206d54 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:33.691708 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-95796b6b-2961-433f-a927-1d2695a14d99 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:33.692565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-95796b6b-2961-433f-a927-1d2695a14d99 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:33.700452 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-95796b6b-2961-433f-a927-1d2695a14d99 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:33.701109 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-95796b6b-2961-433f-a927-1d2695a14d99 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:33.702195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-95796b6b-2961-433f-a927-1d2695a14d99 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:33.702685 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-95796b6b-2961-433f-a927-1d2695a14d99 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:33.761837 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6cccd33c-5acc-4d4b-a021-8f7748206d54 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:33.802636 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6cccd33c-5acc-4d4b-a021-8f7748206d54 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.645985 Jun 22 18:40:33.803674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 237/480] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:33 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:33.956889 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-95796b6b-2961-433f-a927-1d2695a14d99 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:33.999163 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-95796b6b-2961-433f-a927-1d2695a14d99 tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1471 microversion: 2.1 time: 0.314146 Jun 22 18:40:33.999752 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 244/481] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:33 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1471 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:34.101868 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-17b99168-811a-4d9e-89c1-607c18f7ba85 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:34.102706 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-17b99168-811a-4d9e-89c1-607c18f7ba85 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:34.112676 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-17b99168-811a-4d9e-89c1-607c18f7ba85 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:34.113409 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-17b99168-811a-4d9e-89c1-607c18f7ba85 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:34.114590 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-17b99168-811a-4d9e-89c1-607c18f7ba85 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:34.115585 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-17b99168-811a-4d9e-89c1-607c18f7ba85 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:34.701849 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-17b99168-811a-4d9e-89c1-607c18f7ba85 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:34.723256 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-17b99168-811a-4d9e-89c1-607c18f7ba85 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.625140 Jun 22 18:40:34.725776 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 238/482] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:34 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:34.792446 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-955a8575-dd5b-4042-a59c-9f51c4950cee req-81262919-63f1-4297-a233-a96a4581d370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d2858c-1136-4d33-bafd-72671874819f", "name": "network-vif-unplugged", "status": "completed", "tag": "e9f7d927-2770-4d1b-8584-41ef244559ab"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:34.820051 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-92e94674-d437-41a1-a198-936ab3929719 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:34.820590 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-92e94674-d437-41a1-a198-936ab3929719 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:34.823066 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-955a8575-dd5b-4042-a59c-9f51c4950cee req-81262919-63f1-4297-a233-a96a4581d370 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:34.824075 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-955a8575-dd5b-4042-a59c-9f51c4950cee req-81262919-63f1-4297-a233-a96a4581d370 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:34.837945 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-92e94674-d437-41a1-a198-936ab3929719 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:34.838634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-92e94674-d437-41a1-a198-936ab3929719 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:34.839797 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-92e94674-d437-41a1-a198-936ab3929719 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:34.840416 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-92e94674-d437-41a1-a198-936ab3929719 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:34.909110 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-955a8575-dd5b-4042-a59c-9f51c4950cee req-81262919-63f1-4297-a233-a96a4581d370 service nova] Creating event network-vif-unplugged:e9f7d927-2770-4d1b-8584-41ef244559ab for instance e7d2858c-1136-4d33-bafd-72671874819f on hv-cinder-81268 Jun 22 18:40:34.951708 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-955a8575-dd5b-4042-a59c-9f51c4950cee req-81262919-63f1-4297-a233-a96a4581d370 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.163497 Jun 22 18:40:34.954819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 245/483] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:40:35.020513 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e9f5854e-3ae8-4a75-8d92-f2cb118234cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:35.021742 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e9f5854e-3ae8-4a75-8d92-f2cb118234cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:35.038076 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e9f5854e-3ae8-4a75-8d92-f2cb118234cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:35.039218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e9f5854e-3ae8-4a75-8d92-f2cb118234cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:35.041537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e9f5854e-3ae8-4a75-8d92-f2cb118234cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:35.042356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e9f5854e-3ae8-4a75-8d92-f2cb118234cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:35.419112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e9f5854e-3ae8-4a75-8d92-f2cb118234cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:35.430584 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e9f5854e-3ae8-4a75-8d92-f2cb118234cd tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1471 microversion: 2.1 time: 0.417171 Jun 22 18:40:35.431488 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 246/484] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:35 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1471 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:35.447803 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-92e94674-d437-41a1-a198-936ab3929719 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:35.470964 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-92e94674-d437-41a1-a198-936ab3929719 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.654445 Jun 22 18:40:35.484033 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 239/485] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:34 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:35.745138 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f2abff52-715a-44f6-9b35-09b82abd8204 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:35.746559 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f2abff52-715a-44f6-9b35-09b82abd8204 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:35.765070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f2abff52-715a-44f6-9b35-09b82abd8204 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:35.765522 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f2abff52-715a-44f6-9b35-09b82abd8204 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:35.772978 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f2abff52-715a-44f6-9b35-09b82abd8204 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:35.773803 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f2abff52-715a-44f6-9b35-09b82abd8204 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:35.783170 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-777137d4-15a6-40c4-bc6b-68ce6c228613 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Action: 'create', calling method: .version_select at 0x7fd755e5b160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2107367893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGEVq/maH/jejc1THdNtAnpqabcMb94oKoBNY6M9ODRgYZhr8P4ST7/caSzrYw1mO9ff2FP9rQiZZ4ZlXoCEi7tqougwKZPOGhx24v9nHbEy8yx/yGRurDd6PVObCdnvg=="}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:35.828405 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-777137d4-15a6-40c4-bc6b-68ce6c228613 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Getting quotas for project 49c7f224d0374125ae22f576e8757f29. Resources: {'key_pairs'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:40:35.833108 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-777137d4-15a6-40c4-bc6b-68ce6c228613 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Getting quotas for user 00cfbc965d934d6db28f41f8082eb5ef and project 49c7f224d0374125ae22f576e8757f29. Resources: {'key_pairs'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:40:35.878264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-777137d4-15a6-40c4-bc6b-68ce6c228613 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.445621 Jun 22 18:40:35.879416 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 247/486] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 18:40:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:40:36.380386 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-d74c169f-ad39-4553-9188-5d5de59af1e7 req-14b6d7e6-cbf8-4124-b913-423c8af9879b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d2858c-1136-4d33-bafd-72671874819f", "name": "network-vif-deleted", "tag": "e9f7d927-2770-4d1b-8584-41ef244559ab"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:36.403547 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-d74c169f-ad39-4553-9188-5d5de59af1e7 req-14b6d7e6-cbf8-4124-b913-423c8af9879b service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:36.405660 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-d74c169f-ad39-4553-9188-5d5de59af1e7 req-14b6d7e6-cbf8-4124-b913-423c8af9879b service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:36.418561 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-d74c169f-ad39-4553-9188-5d5de59af1e7 req-14b6d7e6-cbf8-4124-b913-423c8af9879b service nova] Creating event network-vif-deleted:e9f7d927-2770-4d1b-8584-41ef244559ab for instance e7d2858c-1136-4d33-bafd-72671874819f on hv-cinder-81268 Jun 22 18:40:36.426678 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-d74c169f-ad39-4553-9188-5d5de59af1e7 req-14b6d7e6-cbf8-4124-b913-423c8af9879b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059357 Jun 22 18:40:36.428395 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 248/487] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:40:36.468723 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-035e1373-a3e7-487e-ac03-8020ef45ed4f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:36.473802 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-035e1373-a3e7-487e-ac03-8020ef45ed4f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:36.489770 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-035e1373-a3e7-487e-ac03-8020ef45ed4f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:36.490468 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-035e1373-a3e7-487e-ac03-8020ef45ed4f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:36.494377 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-035e1373-a3e7-487e-ac03-8020ef45ed4f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:36.495098 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-035e1373-a3e7-487e-ac03-8020ef45ed4f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:36.515693 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f2abff52-715a-44f6-9b35-09b82abd8204 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:36.524356 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f2abff52-715a-44f6-9b35-09b82abd8204 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.784964 Jun 22 18:40:36.530474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 240/488] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:35 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:36.552017 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-dcff7ae3-52c7-4378-8d97-4e89e50be48f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:36.553051 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-dcff7ae3-52c7-4378-8d97-4e89e50be48f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:36.565741 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dcff7ae3-52c7-4378-8d97-4e89e50be48f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:36.569068 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dcff7ae3-52c7-4378-8d97-4e89e50be48f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:36.571211 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dcff7ae3-52c7-4378-8d97-4e89e50be48f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:36.574539 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dcff7ae3-52c7-4378-8d97-4e89e50be48f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:36.675607 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-035e1373-a3e7-487e-ac03-8020ef45ed4f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcb1a1d12c543378d9405606ad84523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7201f0c6ab64901a15c6b8588a8f3fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:36.689110 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-035e1373-a3e7-487e-ac03-8020ef45ed4f tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 200 len: 1300 microversion: 2.1 time: 0.235161 Jun 22 18:40:36.690462 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 249/489] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:36 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 1300 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:36.807863 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-dcff7ae3-52c7-4378-8d97-4e89e50be48f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:36.822894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-dcff7ae3-52c7-4378-8d97-4e89e50be48f tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.283691 Jun 22 18:40:36.824388 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 241/490] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:36 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:37.206033 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c83276f7-c88a-4800-9bea-766dc192c8f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Action: 'create', calling method: .version_select at 0x7fd755ec33a0>, body: {"keypair": {"name": "tempest-keypair-1544607989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5NSAwLucWbpUZQ7qyHsCPYcLsTBraTv2EKZK8tGwYQRTUAfdrRn5MCSrUEInvR6d3Dq35h/AKEOCtmN5U+p0nZBKIbOHUhDfoLtbglLEQdJ9DMyrhhP5P7Q6QV+gdpNA=="}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:37.222006 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-c83276f7-c88a-4800-9bea-766dc192c8f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'key_pairs'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:40:37.227588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-c83276f7-c88a-4800-9bea-766dc192c8f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for user bfa74308096d40daac0a67c9ebec8d8d and project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'key_pairs'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:40:37.257305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c83276f7-c88a-4800-9bea-766dc192c8f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104328 Jun 22 18:40:37.258233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 250/491] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 18:40:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:40:37.557644 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-57efb45b-51f1-49d6-8990-cf6992ba6ca1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:37.558328 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-57efb45b-51f1-49d6-8990-cf6992ba6ca1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:37.569047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-57efb45b-51f1-49d6-8990-cf6992ba6ca1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:37.569759 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-57efb45b-51f1-49d6-8990-cf6992ba6ca1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:37.571296 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-57efb45b-51f1-49d6-8990-cf6992ba6ca1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:37.577188 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-57efb45b-51f1-49d6-8990-cf6992ba6ca1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:37.709057 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-00909d0d-f0ae-4b56-8e02-ef3189665eee tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:37.710632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-00909d0d-f0ae-4b56-8e02-ef3189665eee tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] [instance: e7d2858c-1136-4d33-bafd-72671874819f] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:37.731106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-00909d0d-f0ae-4b56-8e02-ef3189665eee tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:37.731764 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-00909d0d-f0ae-4b56-8e02-ef3189665eee tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:37.735174 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-00909d0d-f0ae-4b56-8e02-ef3189665eee tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:37.735635 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-00909d0d-f0ae-4b56-8e02-ef3189665eee tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:37.768634 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-00909d0d-f0ae-4b56-8e02-ef3189665eee tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] HTTP exception thrown: Instance e7d2858c-1136-4d33-bafd-72671874819f could not be found. Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-00909d0d-f0ae-4b56-8e02-ef3189665eee tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Request method failure captured: Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f HTTP/1.1 Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2Hzv0BbflLBzdlcBYURUhqfOFo9yVLZ1TPxUhBzSM5aWHZhdpVOYsEg_oEV_J93D7A-eMnSOxojRrLmMPV-dC7PPCdAWTJtfTRax3hFC0vzQkEAaFS-twMkWTG0vZegI4cwfh99s6d7Tzoj8nFvZfzkpQXFhErr9yLn9WzLqoykGpE Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: f7201f0c6ab64901a15c6b8588a8f3fd Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-VolumesNegativeTest-384251572 Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:40:37.770209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:40:37.771820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f7201f0c6ab64901a15c6b8588a8f3fd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f7201f0c6ab64901a15c6b8588a8f3fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7201f0c6ab64901a15c6b8588a8f3fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f7201f0c6ab64901a15c6b8588a8f3fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:40:37.771820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-VolumesNegativeTest-384251572 Jun 22 18:40:37.771820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: f7201f0c6ab64901a15c6b8588a8f3fd Jun 22 18:40:37.771820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-VolumesNegativeTest-384251572 Jun 22 18:40:37.771820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-VolumesNegativeTest-384251572-project Jun 22 18:40:37.771820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:40:37.771820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:40:37.771820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 1fcb1a1d12c543378d9405606ad84523 Jun 22 18:40:37.771820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-VolumesNegativeTest-384251572-project Jun 22 18:40:37.771820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:40:37.771820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance e7d2858c-1136-4d33-bafd-72671874819f could not be found. Jun 22 18:40:37.771820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': 'e7d2858c-1136-4d33-bafd-72671874819f'} Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d2858c-1136-4d33-bafd-72671874819f could not be found. Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:40:37.772808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d2858c-1136-4d33-bafd-72671874819f could not be found. Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d2858c-1136-4d33-bafd-72671874819f could not be found. Jun 22 18:40:37.774217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:37.775938 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-00909d0d-f0ae-4b56-8e02-ef3189665eee tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] Returning 404 to user: Instance e7d2858c-1136-4d33-bafd-72671874819f could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:40:37.776450 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-00909d0d-f0ae-4b56-8e02-ef3189665eee tempest-VolumesNegativeTest-384251572 tempest-VolumesNegativeTest-384251572-project] 10.222.0.18 "GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f" status: 404 len: 111 microversion: 2.1 time: 0.068043 Jun 22 18:40:37.781469 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 251/492] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:37 2022] GET /compute/v2.1/servers/e7d2858c-1136-4d33-bafd-72671874819f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:40:37.849764 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-49583c75-6e30-4aa1-8fcc-2f0d10cdbed8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:37.850625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-49583c75-6e30-4aa1-8fcc-2f0d10cdbed8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:37.860221 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-49583c75-6e30-4aa1-8fcc-2f0d10cdbed8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:37.861255 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-49583c75-6e30-4aa1-8fcc-2f0d10cdbed8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:37.863313 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-49583c75-6e30-4aa1-8fcc-2f0d10cdbed8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:37.864111 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-49583c75-6e30-4aa1-8fcc-2f0d10cdbed8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:38.131172 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-49583c75-6e30-4aa1-8fcc-2f0d10cdbed8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:38.142918 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-49583c75-6e30-4aa1-8fcc-2f0d10cdbed8 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.304207 Jun 22 18:40:38.145263 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 252/493] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:37 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:38.219257 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-57efb45b-51f1-49d6-8990-cf6992ba6ca1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:38.230896 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-57efb45b-51f1-49d6-8990-cf6992ba6ca1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.687124 Jun 22 18:40:38.243524 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 242/494] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:37 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:39.161268 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3e08d40b-2ea6-4af3-856c-74857797c928 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:39.161874 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3e08d40b-2ea6-4af3-856c-74857797c928 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:39.172707 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3e08d40b-2ea6-4af3-856c-74857797c928 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:39.173171 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3e08d40b-2ea6-4af3-856c-74857797c928 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:39.173960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3e08d40b-2ea6-4af3-856c-74857797c928 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:39.174388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3e08d40b-2ea6-4af3-856c-74857797c928 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:39.250313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c9687334-71d6-4143-a4a6-0cf0b4f03917 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:39.250925 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c9687334-71d6-4143-a4a6-0cf0b4f03917 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:39.261031 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c9687334-71d6-4143-a4a6-0cf0b4f03917 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:39.269719 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c9687334-71d6-4143-a4a6-0cf0b4f03917 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:39.273284 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c9687334-71d6-4143-a4a6-0cf0b4f03917 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:39.274700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c9687334-71d6-4143-a4a6-0cf0b4f03917 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:39.493519 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3e08d40b-2ea6-4af3-856c-74857797c928 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:39.531518 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3e08d40b-2ea6-4af3-856c-74857797c928 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.374110 Jun 22 18:40:39.532952 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c9687334-71d6-4143-a4a6-0cf0b4f03917 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:39.537126 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 253/495] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:39 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:39.544028 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c9687334-71d6-4143-a4a6-0cf0b4f03917 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.297896 Jun 22 18:40:39.544755 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 243/496] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:39 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:39.627864 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-1639c741-e4a7-4ce2-bc4f-05a21bfaa9d9 req-047cfde0-f3ee-495c-8656-5d9aead3c564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546", "name": "network-vif-plugged", "status": "completed", "tag": "a8b2a978-3992-4cb5-ad2d-53a5c97675c1"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:39.643078 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:39.648705 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-1639c741-e4a7-4ce2-bc4f-05a21bfaa9d9 req-047cfde0-f3ee-495c-8656-5d9aead3c564 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:39.649171 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-1639c741-e4a7-4ce2-bc4f-05a21bfaa9d9 req-047cfde0-f3ee-495c-8656-5d9aead3c564 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:39.683123 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-1639c741-e4a7-4ce2-bc4f-05a21bfaa9d9 req-047cfde0-f3ee-495c-8656-5d9aead3c564 service nova] Creating event network-vif-plugged:a8b2a978-3992-4cb5-ad2d-53a5c97675c1 for instance fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 on hv-cinder-81268 Jun 22 18:40:39.702807 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-1639c741-e4a7-4ce2-bc4f-05a21bfaa9d9 req-047cfde0-f3ee-495c-8656-5d9aead3c564 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106386 Jun 22 18:40:39.704465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 254/497] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:40:40.357823 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-765984700", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22c9b457-d574-4ec6-85ed-412ef1688a3f"}], "security_groups": [{"name": "tempest-securitygroup--1360996698"}], "key_name": "tempest-keypair-1544607989", "user_data": "}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:40.555532 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-01ceeef3-8809-4ad7-b420-b151628b2189 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:40.556266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-01ceeef3-8809-4ad7-b420-b151628b2189 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:40.565071 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-01ceeef3-8809-4ad7-b420-b151628b2189 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:40.565526 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-01ceeef3-8809-4ad7-b420-b151628b2189 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:40.566312 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-01ceeef3-8809-4ad7-b420-b151628b2189 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:40.566752 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-01ceeef3-8809-4ad7-b420-b151628b2189 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:40.572136 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:40.756987 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-01ceeef3-8809-4ad7-b420-b151628b2189 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:40.765724 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-01ceeef3-8809-4ad7-b420-b151628b2189 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1314 microversion: 2.1 time: 0.215337 Jun 22 18:40:40.774854 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 255/498] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:40 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:40.774854 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-bf6f7cd2-966f-4ca7-b1f3-c87858ba3032 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:40.774854 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-bf6f7cd2-966f-4ca7-b1f3-c87858ba3032 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:40.788777 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bf6f7cd2-966f-4ca7-b1f3-c87858ba3032 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:40.789445 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bf6f7cd2-966f-4ca7-b1f3-c87858ba3032 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:40.790572 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bf6f7cd2-966f-4ca7-b1f3-c87858ba3032 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:40.791216 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bf6f7cd2-966f-4ca7-b1f3-c87858ba3032 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:40.968935 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bf6f7cd2-966f-4ca7-b1f3-c87858ba3032 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:40.977671 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-bf6f7cd2-966f-4ca7-b1f3-c87858ba3032 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.209768 Jun 22 18:40:40.979480 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 256/499] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:40 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:41.783361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e7a45c18-9c88-4109-af08-9c265beb8759 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:41.784043 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e7a45c18-9c88-4109-af08-9c265beb8759 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:41.790438 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7a45c18-9c88-4109-af08-9c265beb8759 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:41.791346 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7a45c18-9c88-4109-af08-9c265beb8759 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:41.792919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7a45c18-9c88-4109-af08-9c265beb8759 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:41.793843 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7a45c18-9c88-4109-af08-9c265beb8759 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:41.960420 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e7a45c18-9c88-4109-af08-9c265beb8759 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:41.968108 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e7a45c18-9c88-4109-af08-9c265beb8759 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1497 microversion: 2.1 time: 0.189240 Jun 22 18:40:41.968671 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 257/500] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:41 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:41.997185 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0be878f6-c94f-40e2-8c8c-cb83b3c9c374 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:41.998280 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0be878f6-c94f-40e2-8c8c-cb83b3c9c374 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:42.009908 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0be878f6-c94f-40e2-8c8c-cb83b3c9c374 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:42.010367 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0be878f6-c94f-40e2-8c8c-cb83b3c9c374 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:42.011195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0be878f6-c94f-40e2-8c8c-cb83b3c9c374 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:42.011629 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0be878f6-c94f-40e2-8c8c-cb83b3c9c374 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:42.173923 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0be878f6-c94f-40e2-8c8c-cb83b3c9c374 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:42.190240 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0be878f6-c94f-40e2-8c8c-cb83b3c9c374 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.197009 Jun 22 18:40:42.191160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 258/501] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:41 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:42.500094 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-50cfd4b8-7977-4285-a240-7236126f6ccb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:42.500582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-50cfd4b8-7977-4285-a240-7236126f6ccb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:42.507034 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-50cfd4b8-7977-4285-a240-7236126f6ccb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:42.507475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-50cfd4b8-7977-4285-a240-7236126f6ccb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:42.508258 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-50cfd4b8-7977-4285-a240-7236126f6ccb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:42.508687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-50cfd4b8-7977-4285-a240-7236126f6ccb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:42.536473 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-50cfd4b8-7977-4285-a240-7236126f6ccb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Going to try to terminate instance {{(pid=129744) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:40:42.646817 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-50cfd4b8-7977-4285-a240-7236126f6ccb tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 204 len: 0 microversion: 2.1 time: 0.147642 Jun 22 18:40:42.648060 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 259/502] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:40:42 2022] DELETE /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 18:40:42.660021 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0d19037e-187d-4b72-8457-b6fc23257fca tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:42.661606 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0d19037e-187d-4b72-8457-b6fc23257fca tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:42.669713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0d19037e-187d-4b72-8457-b6fc23257fca tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:42.670154 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0d19037e-187d-4b72-8457-b6fc23257fca tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:42.671036 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0d19037e-187d-4b72-8457-b6fc23257fca tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:42.671472 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0d19037e-187d-4b72-8457-b6fc23257fca tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:42.813040 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0d19037e-187d-4b72-8457-b6fc23257fca tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:42.820577 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0d19037e-187d-4b72-8457-b6fc23257fca tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1503 microversion: 2.1 time: 0.171242 Jun 22 18:40:42.821127 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 260/503] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:42 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:43.207440 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3895f92f-c2bb-4331-8032-06c96214a740 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:43.208085 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3895f92f-c2bb-4331-8032-06c96214a740 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:43.214169 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3895f92f-c2bb-4331-8032-06c96214a740 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:43.214613 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3895f92f-c2bb-4331-8032-06c96214a740 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:43.215368 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3895f92f-c2bb-4331-8032-06c96214a740 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:43.215795 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3895f92f-c2bb-4331-8032-06c96214a740 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:43.349620 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3895f92f-c2bb-4331-8032-06c96214a740 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:43.357810 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3895f92f-c2bb-4331-8032-06c96214a740 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.154368 Jun 22 18:40:43.358459 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 261/504] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:43 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:43.838384 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6a8294d0-780a-4a28-9d7b-ad195c7708b2 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:43.838997 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6a8294d0-780a-4a28-9d7b-ad195c7708b2 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:43.846194 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6a8294d0-780a-4a28-9d7b-ad195c7708b2 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:43.846656 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6a8294d0-780a-4a28-9d7b-ad195c7708b2 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:43.847443 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6a8294d0-780a-4a28-9d7b-ad195c7708b2 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:43.847907 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6a8294d0-780a-4a28-9d7b-ad195c7708b2 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:43.985907 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6a8294d0-780a-4a28-9d7b-ad195c7708b2 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:43.993675 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6a8294d0-780a-4a28-9d7b-ad195c7708b2 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1503 microversion: 2.1 time: 0.159167 Jun 22 18:40:43.994238 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 262/505] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:43 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:44.374770 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-38492b08-c922-4bec-a050-129f5d9c7baa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:44.375479 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-38492b08-c922-4bec-a050-129f5d9c7baa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:44.382976 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-38492b08-c922-4bec-a050-129f5d9c7baa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:44.383543 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-38492b08-c922-4bec-a050-129f5d9c7baa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:44.384850 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-38492b08-c922-4bec-a050-129f5d9c7baa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:44.385613 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-38492b08-c922-4bec-a050-129f5d9c7baa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:44.540736 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-38492b08-c922-4bec-a050-129f5d9c7baa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:44.553452 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-38492b08-c922-4bec-a050-129f5d9c7baa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.182693 Jun 22 18:40:44.554362 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 263/506] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:44 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:44.896589 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-b4521eaf-d11b-4426-b3de-08ba1f362291 req-8641b103-a540-4a49-a41d-79051e097a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546", "name": "network-vif-deleted", "tag": "a8b2a978-3992-4cb5-ad2d-53a5c97675c1"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:40:44.909000 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-b4521eaf-d11b-4426-b3de-08ba1f362291 req-8641b103-a540-4a49-a41d-79051e097a87 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:44.909528 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-b4521eaf-d11b-4426-b3de-08ba1f362291 req-8641b103-a540-4a49-a41d-79051e097a87 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:44.925937 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-b4521eaf-d11b-4426-b3de-08ba1f362291 req-8641b103-a540-4a49-a41d-79051e097a87 service nova] Creating event network-vif-deleted:a8b2a978-3992-4cb5-ad2d-53a5c97675c1 for instance fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 on hv-cinder-81268 Jun 22 18:40:44.934833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-b4521eaf-d11b-4426-b3de-08ba1f362291 req-8641b103-a540-4a49-a41d-79051e097a87 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042567 Jun 22 18:40:44.936467 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 264/507] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:40:45.014991 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e27ecf6c-5a8f-4b06-89fa-3f937ff2aeab tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:45.016167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e27ecf6c-5a8f-4b06-89fa-3f937ff2aeab tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:45.024165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e27ecf6c-5a8f-4b06-89fa-3f937ff2aeab tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:45.024451 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e27ecf6c-5a8f-4b06-89fa-3f937ff2aeab tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:45.025222 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e27ecf6c-5a8f-4b06-89fa-3f937ff2aeab tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:45.025656 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e27ecf6c-5a8f-4b06-89fa-3f937ff2aeab tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:45.067738 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e27ecf6c-5a8f-4b06-89fa-3f937ff2aeab tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:45.069261 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e27ecf6c-5a8f-4b06-89fa-3f937ff2aeab tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:45.069717 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-e27ecf6c-5a8f-4b06-89fa-3f937ff2aeab tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lazy-loading 'fault' on Instance uuid fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:40:45.121437 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e27ecf6c-5a8f-4b06-89fa-3f937ff2aeab tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e671d76c5e5b4d528310abedb603d16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb5e6607fb843bca3fb4a6ae694d47e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:45.130235 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e27ecf6c-5a8f-4b06-89fa-3f937ff2aeab tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 200 len: 1304 microversion: 2.1 time: 0.120900 Jun 22 18:40:45.130800 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 265/508] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:45 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:45.574903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b1e829f6-97dd-473e-a37d-605d2291dbaa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:45.575526 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b1e829f6-97dd-473e-a37d-605d2291dbaa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:45.581919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b1e829f6-97dd-473e-a37d-605d2291dbaa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:45.582352 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b1e829f6-97dd-473e-a37d-605d2291dbaa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:45.583128 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b1e829f6-97dd-473e-a37d-605d2291dbaa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:45.583566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b1e829f6-97dd-473e-a37d-605d2291dbaa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:45.717671 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b1e829f6-97dd-473e-a37d-605d2291dbaa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:45.725298 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b1e829f6-97dd-473e-a37d-605d2291dbaa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.154394 Jun 22 18:40:45.725862 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 266/509] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:45 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:46.149138 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3180b31b-68f4-4a96-bbf9-e6c1c25e2100 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:46.149762 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3180b31b-68f4-4a96-bbf9-e6c1c25e2100 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] [instance: fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:46.157097 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3180b31b-68f4-4a96-bbf9-e6c1c25e2100 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:46.157538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3180b31b-68f4-4a96-bbf9-e6c1c25e2100 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:46.158296 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3180b31b-68f4-4a96-bbf9-e6c1c25e2100 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:46.158726 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3180b31b-68f4-4a96-bbf9-e6c1c25e2100 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:46.172402 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-3180b31b-68f4-4a96-bbf9-e6c1c25e2100 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] HTTP exception thrown: Instance fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 could not be found. Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3180b31b-68f4-4a96-bbf9-e6c1c25e2100 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Request method failure captured: Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 HTTP/1.1 Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2HI5_c8q9UP5dPC3iU-IXN1q0lXt9OQWJaf2wfxEz2VI4QQnUnBWWT3hv6ZOjgu1ycuAwLwGTgkwofgFC7Was8C7OBkV3U4wmYR1NtOBkQeHy4alSI0SxY-lXMjZxPiDLKVgGJG-6Uq5XDxGff_Rjj3jS8-CvXHz-J6vEbSPFCVuH4 Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: ffb5e6607fb843bca3fb4a6ae694d47e Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-VolumesActionsTest-1138445335 Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:40:46.174053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:40:46.175569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ffb5e6607fb843bca3fb4a6ae694d47e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ffb5e6607fb843bca3fb4a6ae694d47e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ffb5e6607fb843bca3fb4a6ae694d47e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ffb5e6607fb843bca3fb4a6ae694d47e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:40:46.175569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-VolumesActionsTest-1138445335 Jun 22 18:40:46.175569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: ffb5e6607fb843bca3fb4a6ae694d47e Jun 22 18:40:46.175569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-VolumesActionsTest-1138445335 Jun 22 18:40:46.175569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-VolumesActionsTest-1138445335-project Jun 22 18:40:46.175569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:40:46.175569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:40:46.175569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: e671d76c5e5b4d528310abedb603d16d Jun 22 18:40:46.175569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-VolumesActionsTest-1138445335-project Jun 22 18:40:46.175569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:40:46.175569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 could not be found. Jun 22 18:40:46.175569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': 'fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546'} Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 could not be found. Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:40:46.176449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 could not be found. Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 could not be found. Jun 22 18:40:46.177833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:40:46.179119 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3180b31b-68f4-4a96-bbf9-e6c1c25e2100 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] Returning 404 to user: Instance fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:40:46.179119 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3180b31b-68f4-4a96-bbf9-e6c1c25e2100 tempest-VolumesActionsTest-1138445335 tempest-VolumesActionsTest-1138445335-project] 10.222.0.18 "GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546" status: 404 len: 111 microversion: 2.1 time: 0.030314 Jun 22 18:40:46.179119 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 267/510] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:46 2022] GET /compute/v2.1/servers/fa8642d4-e1d9-44ab-8c1c-f8c55ae7c546 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 18:40:46.742525 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-94d8bbdb-8b28-494d-b410-2357f5d493a7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:46.743131 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-94d8bbdb-8b28-494d-b410-2357f5d493a7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:46.750747 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-94d8bbdb-8b28-494d-b410-2357f5d493a7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:46.751209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-94d8bbdb-8b28-494d-b410-2357f5d493a7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:46.752023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-94d8bbdb-8b28-494d-b410-2357f5d493a7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:46.752452 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-94d8bbdb-8b28-494d-b410-2357f5d493a7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:46.901145 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-94d8bbdb-8b28-494d-b410-2357f5d493a7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:46.909040 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-94d8bbdb-8b28-494d-b410-2357f5d493a7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.170210 Jun 22 18:40:46.909536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 268/511] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:46 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:47.926364 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-93321b7e-4882-4d0e-85b4-5369e077e2c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:47.927005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-93321b7e-4882-4d0e-85b4-5369e077e2c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:47.929013 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=8 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:47.934560 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-93321b7e-4882-4d0e-85b4-5369e077e2c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:47.935452 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-93321b7e-4882-4d0e-85b4-5369e077e2c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:47.936154 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-93321b7e-4882-4d0e-85b4-5369e077e2c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:47.936635 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-93321b7e-4882-4d0e-85b4-5369e077e2c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:48.065616 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-93321b7e-4882-4d0e-85b4-5369e077e2c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:48.073418 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-93321b7e-4882-4d0e-85b4-5369e077e2c7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.150954 Jun 22 18:40:48.074094 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 269/512] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:47 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:49.091643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b47965e3-c016-475c-af79-88745a4ebab5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:49.092316 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b47965e3-c016-475c-af79-88745a4ebab5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:49.099294 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b47965e3-c016-475c-af79-88745a4ebab5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:49.099735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b47965e3-c016-475c-af79-88745a4ebab5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:49.100534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b47965e3-c016-475c-af79-88745a4ebab5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:49.100964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b47965e3-c016-475c-af79-88745a4ebab5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:49.240937 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b47965e3-c016-475c-af79-88745a4ebab5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:49.249301 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b47965e3-c016-475c-af79-88745a4ebab5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.161994 Jun 22 18:40:49.249848 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 270/513] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:49 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:49.537684 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=44 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:50.266977 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-24caadd8-ec01-4bc0-8f7b-d26741a04dc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:50.267587 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-24caadd8-ec01-4bc0-8f7b-d26741a04dc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:50.273987 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-24caadd8-ec01-4bc0-8f7b-d26741a04dc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:50.274442 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-24caadd8-ec01-4bc0-8f7b-d26741a04dc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:50.275264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-24caadd8-ec01-4bc0-8f7b-d26741a04dc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:50.275738 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-24caadd8-ec01-4bc0-8f7b-d26741a04dc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:50.280173 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:50.369763 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=66 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:40:50.415325 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-24caadd8-ec01-4bc0-8f7b-d26741a04dc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:50.423954 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-24caadd8-ec01-4bc0-8f7b-d26741a04dc5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.161600 Jun 22 18:40:50.424519 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 271/514] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:50 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:51.441159 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-03804bda-4818-4da2-8fe0-864936d3fb8c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:51.441757 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-03804bda-4818-4da2-8fe0-864936d3fb8c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:51.447896 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-03804bda-4818-4da2-8fe0-864936d3fb8c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:51.448341 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-03804bda-4818-4da2-8fe0-864936d3fb8c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:51.449094 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-03804bda-4818-4da2-8fe0-864936d3fb8c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:51.449515 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-03804bda-4818-4da2-8fe0-864936d3fb8c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:51.585576 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-03804bda-4818-4da2-8fe0-864936d3fb8c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:51.593709 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-03804bda-4818-4da2-8fe0-864936d3fb8c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.156590 Jun 22 18:40:51.594272 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 272/515] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:51 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:52.611522 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-76610339-6b49-4c85-a85f-c80009b64059 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:52.612259 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-76610339-6b49-4c85-a85f-c80009b64059 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:52.618580 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76610339-6b49-4c85-a85f-c80009b64059 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:52.619025 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76610339-6b49-4c85-a85f-c80009b64059 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:52.619788 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76610339-6b49-4c85-a85f-c80009b64059 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:52.620292 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76610339-6b49-4c85-a85f-c80009b64059 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:52.760236 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-76610339-6b49-4c85-a85f-c80009b64059 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:52.767807 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-76610339-6b49-4c85-a85f-c80009b64059 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.160758 Jun 22 18:40:52.768380 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 273/516] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:52 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:53.785642 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6e24b5da-4ba7-4952-ad0a-93279c234803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:53.786294 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6e24b5da-4ba7-4952-ad0a-93279c234803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:53.792370 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6e24b5da-4ba7-4952-ad0a-93279c234803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:53.792824 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6e24b5da-4ba7-4952-ad0a-93279c234803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:53.793619 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6e24b5da-4ba7-4952-ad0a-93279c234803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:53.794053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6e24b5da-4ba7-4952-ad0a-93279c234803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:53.934051 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6e24b5da-4ba7-4952-ad0a-93279c234803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:53.942947 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6e24b5da-4ba7-4952-ad0a-93279c234803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.161334 Jun 22 18:40:53.953193 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 274/517] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:53 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:54.150093 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.network.neutron [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] validate_networks() for [('22c9b457-d574-4ec6-85ed-412ef1688a3f', None, None, None, None, None)] {{(pid=129743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:40:54.564656 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Flavor limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:40:54.565210 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Image limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:40:54.565748 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Flavor pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:40:54.566150 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Image pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:40:54.566553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:40:54.580904 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:54.581340 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:54.582125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:54.582548 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:54.603935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:40:54.607793 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for user bfa74308096d40daac0a67c9ebec8d8d and project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:40:54.618896 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Going to run 1 instances... {{(pid=129743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:40:54.621040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:40:54.670693 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e0660a1e-413e-4118-af53-750e2e7f45fc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 14.318634 Jun 22 18:40:54.671502 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 244/518] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:40:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 14321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:40:54.682521 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8b1ae3c4-1ad8-4a83-8609-ae937f354063 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:54.683128 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8b1ae3c4-1ad8-4a83-8609-ae937f354063 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:54.744519 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8b1ae3c4-1ad8-4a83-8609-ae937f354063 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:54.759645 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8b1ae3c4-1ad8-4a83-8609-ae937f354063 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1241 microversion: 2.1 time: 0.081852 Jun 22 18:40:54.760521 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 275/519] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:54 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:40:54.960442 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f45a9105-dde0-48a5-9ce5-4ccb77f78c96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:54.961301 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f45a9105-dde0-48a5-9ce5-4ccb77f78c96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:54.969172 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f45a9105-dde0-48a5-9ce5-4ccb77f78c96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:54.969866 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f45a9105-dde0-48a5-9ce5-4ccb77f78c96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:54.971110 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f45a9105-dde0-48a5-9ce5-4ccb77f78c96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:54.971592 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f45a9105-dde0-48a5-9ce5-4ccb77f78c96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:55.113370 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f45a9105-dde0-48a5-9ce5-4ccb77f78c96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:55.121624 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f45a9105-dde0-48a5-9ce5-4ccb77f78c96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.165236 Jun 22 18:40:55.122183 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 245/520] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:54 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:55.777819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0c07a262-b54e-4283-ad24-797a111d7927 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:55.778421 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0c07a262-b54e-4283-ad24-797a111d7927 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:55.785947 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0c07a262-b54e-4283-ad24-797a111d7927 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:55.786392 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0c07a262-b54e-4283-ad24-797a111d7927 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:55.787153 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0c07a262-b54e-4283-ad24-797a111d7927 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:55.787583 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0c07a262-b54e-4283-ad24-797a111d7927 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:55.853878 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0c07a262-b54e-4283-ad24-797a111d7927 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:55.863297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0c07a262-b54e-4283-ad24-797a111d7927 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1245 microversion: 2.1 time: 0.089257 Jun 22 18:40:55.863877 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 276/521] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:55 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:56.138247 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-fd875aa4-4778-40c2-8f85-d000b5f68437 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:56.139354 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-fd875aa4-4778-40c2-8f85-d000b5f68437 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:56.148642 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fd875aa4-4778-40c2-8f85-d000b5f68437 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:56.148642 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fd875aa4-4778-40c2-8f85-d000b5f68437 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:56.148642 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fd875aa4-4778-40c2-8f85-d000b5f68437 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:56.148642 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fd875aa4-4778-40c2-8f85-d000b5f68437 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:56.286994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-fd875aa4-4778-40c2-8f85-d000b5f68437 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:56.294495 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-fd875aa4-4778-40c2-8f85-d000b5f68437 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.159991 Jun 22 18:40:56.295344 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 246/522] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:56 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:56.879592 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-973ae4c2-c230-4938-ad60-8e4cf12927db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:56.880199 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-973ae4c2-c230-4938-ad60-8e4cf12927db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:56.886507 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-973ae4c2-c230-4938-ad60-8e4cf12927db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:56.886947 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-973ae4c2-c230-4938-ad60-8e4cf12927db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:56.887696 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-973ae4c2-c230-4938-ad60-8e4cf12927db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:56.888164 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-973ae4c2-c230-4938-ad60-8e4cf12927db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:56.955960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-973ae4c2-c230-4938-ad60-8e4cf12927db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:56.963462 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-973ae4c2-c230-4938-ad60-8e4cf12927db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1245 microversion: 2.1 time: 0.087731 Jun 22 18:40:56.964052 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 277/523] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:56 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:57.321865 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7d09055e-5191-40e2-831b-8e9c0cc02456 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:57.322567 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7d09055e-5191-40e2-831b-8e9c0cc02456 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:57.329254 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7d09055e-5191-40e2-831b-8e9c0cc02456 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:57.329781 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7d09055e-5191-40e2-831b-8e9c0cc02456 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:57.330537 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7d09055e-5191-40e2-831b-8e9c0cc02456 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:57.330964 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7d09055e-5191-40e2-831b-8e9c0cc02456 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:57.465467 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7d09055e-5191-40e2-831b-8e9c0cc02456 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:57.473570 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7d09055e-5191-40e2-831b-8e9c0cc02456 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.155764 Jun 22 18:40:57.474112 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 247/524] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:57 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:57.980013 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-987036be-3096-4ca1-87a1-4c36ac7836a6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:57.980619 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-987036be-3096-4ca1-87a1-4c36ac7836a6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:57.986855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-987036be-3096-4ca1-87a1-4c36ac7836a6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:57.987309 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-987036be-3096-4ca1-87a1-4c36ac7836a6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:57.988096 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-987036be-3096-4ca1-87a1-4c36ac7836a6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:57.988529 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-987036be-3096-4ca1-87a1-4c36ac7836a6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:58.048642 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-987036be-3096-4ca1-87a1-4c36ac7836a6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:58.055974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-987036be-3096-4ca1-87a1-4c36ac7836a6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1245 microversion: 2.1 time: 0.079803 Jun 22 18:40:58.056524 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 278/525] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:57 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:58.491656 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-51052957-2950-47ce-9ae3-ea3fe4da2b11 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:58.492305 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-51052957-2950-47ce-9ae3-ea3fe4da2b11 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:58.499185 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-51052957-2950-47ce-9ae3-ea3fe4da2b11 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:58.499617 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-51052957-2950-47ce-9ae3-ea3fe4da2b11 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:58.500410 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-51052957-2950-47ce-9ae3-ea3fe4da2b11 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:58.500838 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-51052957-2950-47ce-9ae3-ea3fe4da2b11 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:58.633311 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-51052957-2950-47ce-9ae3-ea3fe4da2b11 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:58.641439 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-51052957-2950-47ce-9ae3-ea3fe4da2b11 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.153698 Jun 22 18:40:58.642000 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 248/526] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:58 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:59.072769 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d5bcd56d-9d50-486a-86b7-ea0a6848055d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:59.073405 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d5bcd56d-9d50-486a-86b7-ea0a6848055d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:59.079948 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d5bcd56d-9d50-486a-86b7-ea0a6848055d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:59.080401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d5bcd56d-9d50-486a-86b7-ea0a6848055d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:59.081162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d5bcd56d-9d50-486a-86b7-ea0a6848055d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:59.081598 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d5bcd56d-9d50-486a-86b7-ea0a6848055d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:59.141882 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d5bcd56d-9d50-486a-86b7-ea0a6848055d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:59.149233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d5bcd56d-9d50-486a-86b7-ea0a6848055d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1245 microversion: 2.1 time: 0.080367 Jun 22 18:40:59.149778 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 279/527] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:59 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:40:59.659162 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-031efc1a-a968-4088-bbb4-35f98d455e22 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:40:59.659726 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-031efc1a-a968-4088-bbb4-35f98d455e22 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:40:59.665937 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-031efc1a-a968-4088-bbb4-35f98d455e22 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:59.666388 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-031efc1a-a968-4088-bbb4-35f98d455e22 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:59.667149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-031efc1a-a968-4088-bbb4-35f98d455e22 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:40:59.667587 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-031efc1a-a968-4088-bbb4-35f98d455e22 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:40:59.795760 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-031efc1a-a968-4088-bbb4-35f98d455e22 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:40:59.803150 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-031efc1a-a968-4088-bbb4-35f98d455e22 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.148195 Jun 22 18:40:59.803709 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 249/528] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:40:59 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:00.166216 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-90f704b2-f117-4b34-954b-aea3c0641a3b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:00.166815 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-90f704b2-f117-4b34-954b-aea3c0641a3b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:00.173617 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-90f704b2-f117-4b34-954b-aea3c0641a3b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:00.174060 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-90f704b2-f117-4b34-954b-aea3c0641a3b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:00.174810 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-90f704b2-f117-4b34-954b-aea3c0641a3b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:00.175240 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-90f704b2-f117-4b34-954b-aea3c0641a3b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:00.237235 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-90f704b2-f117-4b34-954b-aea3c0641a3b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:00.244686 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-90f704b2-f117-4b34-954b-aea3c0641a3b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1245 microversion: 2.1 time: 0.082333 Jun 22 18:41:00.252321 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 280/529] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:00 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:00.820475 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2b004aad-5b23-4f5b-818c-7376dcba545b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:00.821089 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2b004aad-5b23-4f5b-818c-7376dcba545b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:00.828258 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2b004aad-5b23-4f5b-818c-7376dcba545b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:00.828706 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2b004aad-5b23-4f5b-818c-7376dcba545b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:00.829477 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2b004aad-5b23-4f5b-818c-7376dcba545b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:00.829917 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2b004aad-5b23-4f5b-818c-7376dcba545b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:00.960750 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2b004aad-5b23-4f5b-818c-7376dcba545b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:00.968792 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2b004aad-5b23-4f5b-818c-7376dcba545b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.152125 Jun 22 18:41:00.969366 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 250/530] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:00 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:01.261931 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-413e1920-dd08-452f-9849-21d8ab4df228 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:01.262546 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-413e1920-dd08-452f-9849-21d8ab4df228 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:01.268922 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-413e1920-dd08-452f-9849-21d8ab4df228 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:01.269373 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-413e1920-dd08-452f-9849-21d8ab4df228 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:01.270165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-413e1920-dd08-452f-9849-21d8ab4df228 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:01.270600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-413e1920-dd08-452f-9849-21d8ab4df228 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:01.330114 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-413e1920-dd08-452f-9849-21d8ab4df228 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:01.337483 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-413e1920-dd08-452f-9849-21d8ab4df228 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1245 microversion: 2.1 time: 0.079424 Jun 22 18:41:01.338041 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 281/531] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:01 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:01.985878 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d5be73c0-5a1a-4f44-8d14-6ae44d301da4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:01.986478 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d5be73c0-5a1a-4f44-8d14-6ae44d301da4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:01.993059 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d5be73c0-5a1a-4f44-8d14-6ae44d301da4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:01.993500 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d5be73c0-5a1a-4f44-8d14-6ae44d301da4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:01.994257 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d5be73c0-5a1a-4f44-8d14-6ae44d301da4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:01.994808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d5be73c0-5a1a-4f44-8d14-6ae44d301da4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:02.131904 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d5be73c0-5a1a-4f44-8d14-6ae44d301da4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:02.139913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d5be73c0-5a1a-4f44-8d14-6ae44d301da4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.158139 Jun 22 18:41:02.140466 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 251/532] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:01 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:02.354723 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-761e3fc3-dd20-44e1-b943-13a5bd3aac6d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:02.355285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-761e3fc3-dd20-44e1-b943-13a5bd3aac6d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:02.361618 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-761e3fc3-dd20-44e1-b943-13a5bd3aac6d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:02.362516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-761e3fc3-dd20-44e1-b943-13a5bd3aac6d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:02.362809 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-761e3fc3-dd20-44e1-b943-13a5bd3aac6d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:02.363242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-761e3fc3-dd20-44e1-b943-13a5bd3aac6d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:02.424519 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-761e3fc3-dd20-44e1-b943-13a5bd3aac6d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:02.431913 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-761e3fc3-dd20-44e1-b943-13a5bd3aac6d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1245 microversion: 2.1 time: 0.081115 Jun 22 18:41:02.432467 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 282/533] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:02 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:03.156576 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6fd3c83c-65f1-4d4d-8591-9938cd3ea9f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:03.157189 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6fd3c83c-65f1-4d4d-8591-9938cd3ea9f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:03.163636 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6fd3c83c-65f1-4d4d-8591-9938cd3ea9f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:03.164110 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6fd3c83c-65f1-4d4d-8591-9938cd3ea9f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:03.164875 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6fd3c83c-65f1-4d4d-8591-9938cd3ea9f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:03.165307 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6fd3c83c-65f1-4d4d-8591-9938cd3ea9f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:03.290718 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6fd3c83c-65f1-4d4d-8591-9938cd3ea9f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:03.298369 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6fd3c83c-65f1-4d4d-8591-9938cd3ea9f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.146383 Jun 22 18:41:03.298926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 252/534] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:03 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:03.449515 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e7ff5c02-4fff-4711-b083-e324536ffd43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:03.450058 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e7ff5c02-4fff-4711-b083-e324536ffd43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:03.456613 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7ff5c02-4fff-4711-b083-e324536ffd43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:03.457063 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7ff5c02-4fff-4711-b083-e324536ffd43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:03.457819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7ff5c02-4fff-4711-b083-e324536ffd43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:03.458251 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7ff5c02-4fff-4711-b083-e324536ffd43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:03.517695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e7ff5c02-4fff-4711-b083-e324536ffd43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:03.525082 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e7ff5c02-4fff-4711-b083-e324536ffd43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1245 microversion: 2.1 time: 0.079448 Jun 22 18:41:03.525633 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 283/535] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:03 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:04.315446 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-88289340-6f5a-461d-97a8-d40896495a7f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:04.316077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-88289340-6f5a-461d-97a8-d40896495a7f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:04.322472 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-88289340-6f5a-461d-97a8-d40896495a7f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:04.322915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-88289340-6f5a-461d-97a8-d40896495a7f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:04.323665 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-88289340-6f5a-461d-97a8-d40896495a7f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:04.324134 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-88289340-6f5a-461d-97a8-d40896495a7f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:04.456733 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-88289340-6f5a-461d-97a8-d40896495a7f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:04.464370 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-88289340-6f5a-461d-97a8-d40896495a7f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.152723 Jun 22 18:41:04.464934 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 253/536] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:04 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:04.542263 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-dd8f3981-c66a-4462-b2b3-053c10840cba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:04.542978 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-dd8f3981-c66a-4462-b2b3-053c10840cba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:04.550045 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd8f3981-c66a-4462-b2b3-053c10840cba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:04.550483 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd8f3981-c66a-4462-b2b3-053c10840cba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:04.551235 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd8f3981-c66a-4462-b2b3-053c10840cba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:04.551658 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd8f3981-c66a-4462-b2b3-053c10840cba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:04.614158 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dd8f3981-c66a-4462-b2b3-053c10840cba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:04.621488 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-dd8f3981-c66a-4462-b2b3-053c10840cba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1245 microversion: 2.1 time: 0.083325 Jun 22 18:41:04.622034 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 284/537] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:04 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:05.481683 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-9dc48ec4-1441-4b39-9530-7da4bad3547b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:05.482995 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-9dc48ec4-1441-4b39-9530-7da4bad3547b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:05.484866 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:05.485831 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=6 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:05.493039 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9dc48ec4-1441-4b39-9530-7da4bad3547b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:05.493782 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9dc48ec4-1441-4b39-9530-7da4bad3547b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:05.494628 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9dc48ec4-1441-4b39-9530-7da4bad3547b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:05.495121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9dc48ec4-1441-4b39-9530-7da4bad3547b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:05.633453 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-9dc48ec4-1441-4b39-9530-7da4bad3547b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:05.639220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-52c73dcc-287e-497a-b636-f72bf5f7b746 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:05.640572 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-52c73dcc-287e-497a-b636-f72bf5f7b746 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:05.642011 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-9dc48ec4-1441-4b39-9530-7da4bad3547b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.164190 Jun 22 18:41:05.642965 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 254/538] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:05 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:05.662065 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:05.668303 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-52c73dcc-287e-497a-b636-f72bf5f7b746 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:05.669564 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-52c73dcc-287e-497a-b636-f72bf5f7b746 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:05.670638 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-52c73dcc-287e-497a-b636-f72bf5f7b746 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:05.671169 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-52c73dcc-287e-497a-b636-f72bf5f7b746 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:05.770650 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-52c73dcc-287e-497a-b636-f72bf5f7b746 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:05.784484 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-52c73dcc-287e-497a-b636-f72bf5f7b746 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1245 microversion: 2.1 time: 0.148830 Jun 22 18:41:05.796012 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 285/539] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:05 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1245 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:41:06.658801 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-91def274-5a5e-4217-85fe-86ce5b077856 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:06.659431 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-91def274-5a5e-4217-85fe-86ce5b077856 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:06.667184 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91def274-5a5e-4217-85fe-86ce5b077856 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:06.667617 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91def274-5a5e-4217-85fe-86ce5b077856 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:06.668607 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91def274-5a5e-4217-85fe-86ce5b077856 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:06.669626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91def274-5a5e-4217-85fe-86ce5b077856 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:06.822154 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8540b327-0f3e-4a5d-a381-7851c652c636 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:06.822791 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8540b327-0f3e-4a5d-a381-7851c652c636 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:06.830344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8540b327-0f3e-4a5d-a381-7851c652c636 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:06.830794 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8540b327-0f3e-4a5d-a381-7851c652c636 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:06.831611 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8540b327-0f3e-4a5d-a381-7851c652c636 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:06.832319 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8540b327-0f3e-4a5d-a381-7851c652c636 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:06.964847 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8540b327-0f3e-4a5d-a381-7851c652c636 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:06.985127 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8540b327-0f3e-4a5d-a381-7851c652c636 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1293 microversion: 2.1 time: 0.183550 Jun 22 18:41:06.989311 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 286/540] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:06 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1293 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:06.998894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-91def274-5a5e-4217-85fe-86ce5b077856 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:07.007590 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-91def274-5a5e-4217-85fe-86ce5b077856 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.352540 Jun 22 18:41:07.018048 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 255/541] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:06 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:08.006059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-11410fbb-e939-47d9-a0bd-a9a65464ab38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:08.006900 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-11410fbb-e939-47d9-a0bd-a9a65464ab38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:08.019219 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-11410fbb-e939-47d9-a0bd-a9a65464ab38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:08.025563 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f01c8a56-8ef7-4af3-b8b6-6bffb33a9688 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:08.027010 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f01c8a56-8ef7-4af3-b8b6-6bffb33a9688 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:08.028645 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-11410fbb-e939-47d9-a0bd-a9a65464ab38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:08.029822 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-11410fbb-e939-47d9-a0bd-a9a65464ab38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:08.030324 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-11410fbb-e939-47d9-a0bd-a9a65464ab38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:08.037179 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f01c8a56-8ef7-4af3-b8b6-6bffb33a9688 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:08.038074 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f01c8a56-8ef7-4af3-b8b6-6bffb33a9688 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:08.039258 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f01c8a56-8ef7-4af3-b8b6-6bffb33a9688 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:08.039998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f01c8a56-8ef7-4af3-b8b6-6bffb33a9688 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:08.139621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-11410fbb-e939-47d9-a0bd-a9a65464ab38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:08.148739 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-11410fbb-e939-47d9-a0bd-a9a65464ab38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1301 microversion: 2.1 time: 0.147389 Jun 22 18:41:08.149308 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 287/542] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:08 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1301 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:08.234138 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f01c8a56-8ef7-4af3-b8b6-6bffb33a9688 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:08.242903 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f01c8a56-8ef7-4af3-b8b6-6bffb33a9688 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1501 microversion: 2.1 time: 0.221487 Jun 22 18:41:08.243704 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 256/543] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:08 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:08.260519 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f7228602-3387-4636-a908-9c2d94548850 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31582e4a-597b-480f-898d-ab062b2f3976"}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:08.261676 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f7228602-3387-4636-a908-9c2d94548850 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:08.268451 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f7228602-3387-4636-a908-9c2d94548850 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:08.268937 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f7228602-3387-4636-a908-9c2d94548850 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:08.269806 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f7228602-3387-4636-a908-9c2d94548850 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:08.270419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f7228602-3387-4636-a908-9c2d94548850 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:08.296893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-f7228602-3387-4636-a908-9c2d94548850 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] HTTP exception thrown: Cannot 'attach_volume' instance 66481d9b-408f-4891-8b17-76fface18ff4 while it is in vm_state rescued Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f7228602-3387-4636-a908-9c2d94548850 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Request method failure captured: Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: POST /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4/os-volume_attachments HTTP/1.1 Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 74 Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2GNWSRtAX4FCk4LKPpi2_4oWKg9AzU00FZZox6EKvRPv3yOEoSkqMJkrp8JcBA7WmQt8XgNCQItYQFcBY7IUMtSbG8XqaBpHjESKBr-Rg576Nkmc8jTKetJOWTVZ3d5ny-d34E1fPriTEmE5WqlnluiEkCCfs9w6t1LdNoFGljh4Gc Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: d866c4a659e74e42a3c37050eae82229 Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:41:08.298875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:41:08.300621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d866c4a659e74e42a3c37050eae82229", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:41:08.300621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:41:08.300621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: d866c4a659e74e42a3c37050eae82229 Jun 22 18:41:08.300621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:41:08.300621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-ServerRescueNegativeTestJSON-1877302870-project Jun 22 18:41:08.300621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:41:08.300621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:41:08.300621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 94d5713dc97f442f916b22d925c35042 Jun 22 18:41:08.300621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1877302870-project Jun 22 18:41:08.300621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Jun 22 18:41:08.300621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {"volumeAttachment": {"volumeId": "31582e4a-597b-480f-898d-ab062b2f3976"}} Jun 22 18:41:08.300621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Cannot 'attach_volume' instance 66481d9b-408f-4891-8b17-76fface18ff4 while it is in vm_state rescued Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'server_id': '66481d9b-408f-4891-8b17-76fface18ff4', 'body': {'volumeAttachment': {'volumeId': '31582e4a-597b-480f-898d-ab062b2f3976'}}} Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 66481d9b-408f-4891-8b17-76fface18ff4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:41:08.301649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 66481d9b-408f-4891-8b17-76fface18ff4 while it is in vm_state rescued Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:41:08.303264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:41:08.304959 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:41:08.304959 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:41:08.304959 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 66481d9b-408f-4891-8b17-76fface18ff4 while it is in vm_state rescued Jun 22 18:41:08.304959 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:41:08.306279 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f7228602-3387-4636-a908-9c2d94548850 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Returning 409 to user: Cannot 'attach_volume' instance 66481d9b-408f-4891-8b17-76fface18ff4 while it is in vm_state rescued {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:41:08.307401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f7228602-3387-4636-a908-9c2d94548850 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "POST /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051252 Jun 22 18:41:08.308536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 288/544] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:41:08 2022] POST /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 18:41:08.318264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-614e9f40-c9d8-4b54-936d-cf68ca04b529 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:08.319052 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-614e9f40-c9d8-4b54-936d-cf68ca04b529 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:08.331132 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-614e9f40-c9d8-4b54-936d-cf68ca04b529 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:08.332807 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-614e9f40-c9d8-4b54-936d-cf68ca04b529 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:08.333770 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-614e9f40-c9d8-4b54-936d-cf68ca04b529 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:08.334318 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-614e9f40-c9d8-4b54-936d-cf68ca04b529 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:08.428906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-614e9f40-c9d8-4b54-936d-cf68ca04b529 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "POST /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4/action" status: 202 len: 0 microversion: 2.1 time: 0.114786 Jun 22 18:41:08.430375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 257/545] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:41:08 2022] POST /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:41:08.440236 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ebe92e7a-acaf-4cc1-b02d-9c86c908fcce tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:08.441270 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ebe92e7a-acaf-4cc1-b02d-9c86c908fcce tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:08.452083 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ebe92e7a-acaf-4cc1-b02d-9c86c908fcce tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:08.456108 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ebe92e7a-acaf-4cc1-b02d-9c86c908fcce tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:08.457539 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ebe92e7a-acaf-4cc1-b02d-9c86c908fcce tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:08.460539 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ebe92e7a-acaf-4cc1-b02d-9c86c908fcce tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:08.530525 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=100 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:08.679441 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ebe92e7a-acaf-4cc1-b02d-9c86c908fcce tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:08.688664 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ebe92e7a-acaf-4cc1-b02d-9c86c908fcce tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1509 microversion: 2.1 time: 0.252648 Jun 22 18:41:08.689644 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 289/546] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:08 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:09.169575 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-39c80ecf-e627-43c9-b8fd-71cb398fa18f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:09.171170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-39c80ecf-e627-43c9-b8fd-71cb398fa18f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:09.180442 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-39c80ecf-e627-43c9-b8fd-71cb398fa18f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:09.181246 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-39c80ecf-e627-43c9-b8fd-71cb398fa18f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:09.181974 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-39c80ecf-e627-43c9-b8fd-71cb398fa18f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:09.182416 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-39c80ecf-e627-43c9-b8fd-71cb398fa18f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:09.287868 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-39c80ecf-e627-43c9-b8fd-71cb398fa18f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:09.296393 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-39c80ecf-e627-43c9-b8fd-71cb398fa18f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1299 microversion: 2.1 time: 0.133396 Jun 22 18:41:09.297166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 258/547] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:09 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:09.712124 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-de1e8e8e-8c00-4377-95c6-8dacbc67cb66 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:09.713233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-de1e8e8e-8c00-4377-95c6-8dacbc67cb66 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:09.730991 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-de1e8e8e-8c00-4377-95c6-8dacbc67cb66 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:09.732940 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-de1e8e8e-8c00-4377-95c6-8dacbc67cb66 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:09.734112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-de1e8e8e-8c00-4377-95c6-8dacbc67cb66 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:09.734779 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-de1e8e8e-8c00-4377-95c6-8dacbc67cb66 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:09.979542 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-de1e8e8e-8c00-4377-95c6-8dacbc67cb66 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:09.991234 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-de1e8e8e-8c00-4377-95c6-8dacbc67cb66 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1509 microversion: 2.1 time: 0.283148 Jun 22 18:41:10.002943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 290/548] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:09 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1509 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:10.316544 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6e55ebe9-2aec-4136-ae40-f37d45f1a6c3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:10.317159 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6e55ebe9-2aec-4136-ae40-f37d45f1a6c3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:10.330073 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6e55ebe9-2aec-4136-ae40-f37d45f1a6c3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:10.331637 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6e55ebe9-2aec-4136-ae40-f37d45f1a6c3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:10.332672 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6e55ebe9-2aec-4136-ae40-f37d45f1a6c3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:10.333761 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6e55ebe9-2aec-4136-ae40-f37d45f1a6c3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:10.596448 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6e55ebe9-2aec-4136-ae40-f37d45f1a6c3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:10.609076 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6e55ebe9-2aec-4136-ae40-f37d45f1a6c3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1367 microversion: 2.1 time: 0.299693 Jun 22 18:41:10.610326 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 259/549] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:10 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:11.009759 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3837dcbb-5e8e-4b14-a609-14f66bbea11f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:11.011099 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3837dcbb-5e8e-4b14-a609-14f66bbea11f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:11.025789 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:11.029251 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3837dcbb-5e8e-4b14-a609-14f66bbea11f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:11.030073 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3837dcbb-5e8e-4b14-a609-14f66bbea11f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:11.031573 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3837dcbb-5e8e-4b14-a609-14f66bbea11f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:11.032274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3837dcbb-5e8e-4b14-a609-14f66bbea11f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:11.233313 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3837dcbb-5e8e-4b14-a609-14f66bbea11f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:11.244107 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3837dcbb-5e8e-4b14-a609-14f66bbea11f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1509 microversion: 2.1 time: 0.238845 Jun 22 18:41:11.253753 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 291/550] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:11 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:11.312556 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-34d7fb47-ef0c-4507-9672-8c5ca5503fdc req-977f6b4b-c5d1-43eb-a952-c8198ede6df6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc", "tag": "fe5449d7-e40a-4798-93d2-909f1771b70d"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:11.347492 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-34d7fb47-ef0c-4507-9672-8c5ca5503fdc req-977f6b4b-c5d1-43eb-a952-c8198ede6df6 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:11.348937 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-34d7fb47-ef0c-4507-9672-8c5ca5503fdc req-977f6b4b-c5d1-43eb-a952-c8198ede6df6 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:11.371387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:11.374206 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-34d7fb47-ef0c-4507-9672-8c5ca5503fdc req-977f6b4b-c5d1-43eb-a952-c8198ede6df6 service nova] Creating event network-changed:fe5449d7-e40a-4798-93d2-909f1771b70d for instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc on hv-cinder-81268 Jun 22 18:41:11.380272 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-34d7fb47-ef0c-4507-9672-8c5ca5503fdc req-977f6b4b-c5d1-43eb-a952-c8198ede6df6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075072 Jun 22 18:41:11.381028 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 260/551] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:41:11.626937 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b98cfc20-d463-4186-969d-bd8a52d4d29d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:11.627757 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b98cfc20-d463-4186-969d-bd8a52d4d29d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:11.634367 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b98cfc20-d463-4186-969d-bd8a52d4d29d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:11.634897 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b98cfc20-d463-4186-969d-bd8a52d4d29d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:11.635764 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b98cfc20-d463-4186-969d-bd8a52d4d29d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:11.636295 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b98cfc20-d463-4186-969d-bd8a52d4d29d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:11.807085 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b98cfc20-d463-4186-969d-bd8a52d4d29d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:11.815594 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b98cfc20-d463-4186-969d-bd8a52d4d29d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1367 microversion: 2.1 time: 0.193276 Jun 22 18:41:11.819880 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 292/552] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:11 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:12.264106 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b6b03b56-9a02-4774-8b97-14af3ba6946a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:12.265366 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b6b03b56-9a02-4774-8b97-14af3ba6946a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:12.274529 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b6b03b56-9a02-4774-8b97-14af3ba6946a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:12.274977 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b6b03b56-9a02-4774-8b97-14af3ba6946a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:12.276098 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b6b03b56-9a02-4774-8b97-14af3ba6946a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:12.276233 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b6b03b56-9a02-4774-8b97-14af3ba6946a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:12.473129 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b6b03b56-9a02-4774-8b97-14af3ba6946a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:12.484626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b6b03b56-9a02-4774-8b97-14af3ba6946a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1509 microversion: 2.1 time: 0.226290 Jun 22 18:41:12.485228 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 261/553] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:12 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:12.832724 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-51142b2f-9fd8-41f4-98d7-79584cda3783 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:12.833547 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-51142b2f-9fd8-41f4-98d7-79584cda3783 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:12.844575 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-51142b2f-9fd8-41f4-98d7-79584cda3783 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:12.845033 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-51142b2f-9fd8-41f4-98d7-79584cda3783 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:12.845911 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-51142b2f-9fd8-41f4-98d7-79584cda3783 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:12.846382 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-51142b2f-9fd8-41f4-98d7-79584cda3783 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:13.000624 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-51142b2f-9fd8-41f4-98d7-79584cda3783 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:13.009176 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-51142b2f-9fd8-41f4-98d7-79584cda3783 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1367 microversion: 2.1 time: 0.180673 Jun 22 18:41:13.010287 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 293/554] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:12 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:13.501859 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-855c26c8-2792-4d2c-934a-1f0ad24618dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:13.503065 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-855c26c8-2792-4d2c-934a-1f0ad24618dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:13.509932 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-855c26c8-2792-4d2c-934a-1f0ad24618dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:13.510586 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-855c26c8-2792-4d2c-934a-1f0ad24618dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:13.511383 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-855c26c8-2792-4d2c-934a-1f0ad24618dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:13.511806 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-855c26c8-2792-4d2c-934a-1f0ad24618dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:13.681421 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-855c26c8-2792-4d2c-934a-1f0ad24618dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:13.690389 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-855c26c8-2792-4d2c-934a-1f0ad24618dd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1509 microversion: 2.1 time: 0.192433 Jun 22 18:41:13.691267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 262/555] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:13 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:14.031414 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ddfef843-4dfa-4b07-b578-a4a0aed5bf0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:14.032408 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ddfef843-4dfa-4b07-b578-a4a0aed5bf0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:14.047069 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ddfef843-4dfa-4b07-b578-a4a0aed5bf0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:14.047908 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ddfef843-4dfa-4b07-b578-a4a0aed5bf0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:14.049311 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ddfef843-4dfa-4b07-b578-a4a0aed5bf0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:14.050187 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ddfef843-4dfa-4b07-b578-a4a0aed5bf0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:14.228259 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ddfef843-4dfa-4b07-b578-a4a0aed5bf0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:14.244435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ddfef843-4dfa-4b07-b578-a4a0aed5bf0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1367 microversion: 2.1 time: 0.218671 Jun 22 18:41:14.245768 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 294/556] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:14 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:14.713063 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f5d2febf-4570-4fb1-853b-1cba02cecd68 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:14.714373 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f5d2febf-4570-4fb1-853b-1cba02cecd68 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:14.722635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5d2febf-4570-4fb1-853b-1cba02cecd68 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:14.723298 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5d2febf-4570-4fb1-853b-1cba02cecd68 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:14.724298 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5d2febf-4570-4fb1-853b-1cba02cecd68 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:14.724885 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5d2febf-4570-4fb1-853b-1cba02cecd68 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:15.005678 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f5d2febf-4570-4fb1-853b-1cba02cecd68 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:15.015278 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f5d2febf-4570-4fb1-853b-1cba02cecd68 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1509 microversion: 2.1 time: 0.306417 Jun 22 18:41:15.015278 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 263/557] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:14 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1509 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:15.265047 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4fee944e-983c-41f3-818c-46c98b0f2229 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:15.266284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4fee944e-983c-41f3-818c-46c98b0f2229 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:15.273396 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4fee944e-983c-41f3-818c-46c98b0f2229 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:15.273852 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4fee944e-983c-41f3-818c-46c98b0f2229 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:15.274808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4fee944e-983c-41f3-818c-46c98b0f2229 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:15.275448 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4fee944e-983c-41f3-818c-46c98b0f2229 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:15.433831 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4fee944e-983c-41f3-818c-46c98b0f2229 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:15.443884 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4fee944e-983c-41f3-818c-46c98b0f2229 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1367 microversion: 2.1 time: 0.185207 Jun 22 18:41:15.444666 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 295/558] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:15 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:16.031740 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-9d2351d9-bbca-49b3-9c98-9d9c30f6e961 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:16.032355 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-9d2351d9-bbca-49b3-9c98-9d9c30f6e961 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:16.039629 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9d2351d9-bbca-49b3-9c98-9d9c30f6e961 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:16.040266 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9d2351d9-bbca-49b3-9c98-9d9c30f6e961 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:16.041110 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9d2351d9-bbca-49b3-9c98-9d9c30f6e961 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:16.041564 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9d2351d9-bbca-49b3-9c98-9d9c30f6e961 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:16.211440 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-9d2351d9-bbca-49b3-9c98-9d9c30f6e961 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:16.219878 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-9d2351d9-bbca-49b3-9c98-9d9c30f6e961 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1515 microversion: 2.1 time: 0.192586 Jun 22 18:41:16.220453 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 264/559] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:16 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:16.465626 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e44a16ae-b2d7-4b69-badc-c7f0ecbe853a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:16.466761 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e44a16ae-b2d7-4b69-badc-c7f0ecbe853a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:16.488910 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e44a16ae-b2d7-4b69-badc-c7f0ecbe853a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:16.489652 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e44a16ae-b2d7-4b69-badc-c7f0ecbe853a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:16.490580 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e44a16ae-b2d7-4b69-badc-c7f0ecbe853a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:16.491144 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e44a16ae-b2d7-4b69-badc-c7f0ecbe853a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:16.731628 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e44a16ae-b2d7-4b69-badc-c7f0ecbe853a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:16.739639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e44a16ae-b2d7-4b69-badc-c7f0ecbe853a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1367 microversion: 2.1 time: 0.280574 Jun 22 18:41:16.740233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 296/560] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:16 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:17.756732 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6a3f74c3-3e3b-42f1-9e05-a576baf65691 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:17.757345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6a3f74c3-3e3b-42f1-9e05-a576baf65691 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:17.764841 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6a3f74c3-3e3b-42f1-9e05-a576baf65691 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:17.765568 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6a3f74c3-3e3b-42f1-9e05-a576baf65691 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:17.766815 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6a3f74c3-3e3b-42f1-9e05-a576baf65691 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:17.767419 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6a3f74c3-3e3b-42f1-9e05-a576baf65691 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:17.914486 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6a3f74c3-3e3b-42f1-9e05-a576baf65691 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:17.922738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6a3f74c3-3e3b-42f1-9e05-a576baf65691 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1367 microversion: 2.1 time: 0.170599 Jun 22 18:41:17.923335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 265/561] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:17 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:18.738053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-11ab226f-5a0b-4331-9138-1de1bd1736af tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Action: 'create', calling method: .version_select at 0x7fd755e84f70>, body: {"keypair": {"name": "tempest-keypair-1949485267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOXicy8G9e/DcgUHbzTcWntZGJSHpQzCdfM4wVrGXyizFAiP9jRHNMqyuOQhp3sc/+sefvSmXaLWZArvh69OpQ0WPfLc8WGmAZXBTpGPcuohLhaasu0YTKG64lhVTzx5w=="}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:18.755887 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-11ab226f-5a0b-4331-9138-1de1bd1736af tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Getting quotas for project d866c4a659e74e42a3c37050eae82229. Resources: {'key_pairs'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:41:18.760156 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-11ab226f-5a0b-4331-9138-1de1bd1736af tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Getting quotas for user 94d5713dc97f442f916b22d925c35042 and project d866c4a659e74e42a3c37050eae82229. Resources: {'key_pairs'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:41:18.791139 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-11ab226f-5a0b-4331-9138-1de1bd1736af tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056537 Jun 22 18:41:18.798024 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 297/562] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 18:41:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:41:18.942129 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5c087b93-0dac-4b92-a613-2ed44ceaf6ba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:18.943606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5c087b93-0dac-4b92-a613-2ed44ceaf6ba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:18.952050 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5c087b93-0dac-4b92-a613-2ed44ceaf6ba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:18.952871 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5c087b93-0dac-4b92-a613-2ed44ceaf6ba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:18.953806 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5c087b93-0dac-4b92-a613-2ed44ceaf6ba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:18.954235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5c087b93-0dac-4b92-a613-2ed44ceaf6ba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:19.166691 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5c087b93-0dac-4b92-a613-2ed44ceaf6ba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:19.180005 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5c087b93-0dac-4b92-a613-2ed44ceaf6ba tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1367 microversion: 2.1 time: 0.243548 Jun 22 18:41:19.180825 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 266/563] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:18 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:41:20.202363 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2c0802de-5074-42b7-bef2-8af4c109d958 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:20.204440 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2c0802de-5074-42b7-bef2-8af4c109d958 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:20.213011 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2c0802de-5074-42b7-bef2-8af4c109d958 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:20.214067 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2c0802de-5074-42b7-bef2-8af4c109d958 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:20.216540 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2c0802de-5074-42b7-bef2-8af4c109d958 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:20.217727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2c0802de-5074-42b7-bef2-8af4c109d958 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:20.425519 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-802041008", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fedf922-6bd0-4d18-856d-d78514e18614"}], "security_groups": [{"name": "tempest-securitygroup--1033731175"}], "key_name": "tempest-keypair-1949485267", "user_data": "}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:20.436248 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:20.462183 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-2c0802de-5074-42b7-bef2-8af4c109d958 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:20.471626 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2c0802de-5074-42b7-bef2-8af4c109d958 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1367 microversion: 2.1 time: 0.277506 Jun 22 18:41:20.472267 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 298/564] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:20 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:41:20.538342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.network.neutron [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] validate_networks() for [('7fedf922-6bd0-4d18-856d-d78514e18614', None, None, None, None, None)] {{(pid=129743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:41:20.963020 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Flavor limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:41:20.963132 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Image limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:41:20.963514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Flavor pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:41:20.964143 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Image pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:41:20.964861 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:41:20.977214 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:20.977670 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:20.978482 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:20.980034 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:21.000599 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Getting quotas for project d866c4a659e74e42a3c37050eae82229. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:41:21.015914 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Getting quotas for user 94d5713dc97f442f916b22d925c35042 and project d866c4a659e74e42a3c37050eae82229. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:41:21.029179 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Going to run 1 instances... {{(pid=129743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:41:21.031642 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:41:21.086805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-086efe12-3588-4162-8da8-64a7fa3141ed tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.665441 Jun 22 18:41:21.093434 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 267/565] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:41:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:41:21.100332 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-59865e20-5d73-4f28-964d-c831df37c685 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:21.101303 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-59865e20-5d73-4f28-964d-c831df37c685 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:21.178609 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-59865e20-5d73-4f28-964d-c831df37c685 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:21.186481 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-59865e20-5d73-4f28-964d-c831df37c685 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1245 microversion: 2.1 time: 0.091358 Jun 22 18:41:21.187225 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 299/566] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:21 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:21.489801 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-377b0db6-96af-4d6f-91bf-cd8e56b78978 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:21.493117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-377b0db6-96af-4d6f-91bf-cd8e56b78978 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:21.502146 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-377b0db6-96af-4d6f-91bf-cd8e56b78978 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:21.502931 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-377b0db6-96af-4d6f-91bf-cd8e56b78978 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:21.504016 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-377b0db6-96af-4d6f-91bf-cd8e56b78978 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:21.504656 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-377b0db6-96af-4d6f-91bf-cd8e56b78978 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:21.701386 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-377b0db6-96af-4d6f-91bf-cd8e56b78978 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:21.711620 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-377b0db6-96af-4d6f-91bf-cd8e56b78978 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1367 microversion: 2.1 time: 0.225895 Jun 22 18:41:21.712982 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 268/567] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:21 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:21.842323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-7754cc4b-2b40-4e9f-bf0d-a4bee9ca53a5 req-baa6c156-5b84-4cdd-8cd5-23d19f5e56dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc", "name": "network-vif-plugged", "status": "completed", "tag": "fe5449d7-e40a-4798-93d2-909f1771b70d"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:21.857588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-7754cc4b-2b40-4e9f-bf0d-a4bee9ca53a5 req-baa6c156-5b84-4cdd-8cd5-23d19f5e56dc service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:21.858630 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-7754cc4b-2b40-4e9f-bf0d-a4bee9ca53a5 req-baa6c156-5b84-4cdd-8cd5-23d19f5e56dc service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:21.871964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-7754cc4b-2b40-4e9f-bf0d-a4bee9ca53a5 req-baa6c156-5b84-4cdd-8cd5-23d19f5e56dc service nova] Creating event network-vif-plugged:fe5449d7-e40a-4798-93d2-909f1771b70d for instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc on hv-cinder-81268 Jun 22 18:41:21.882298 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-7754cc4b-2b40-4e9f-bf0d-a4bee9ca53a5 req-baa6c156-5b84-4cdd-8cd5-23d19f5e56dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043925 Jun 22 18:41:21.884345 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 300/568] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:41:22.213964 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-86ba2ecd-80a2-4c5b-a744-6a4ec2c1e648 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:22.214575 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-86ba2ecd-80a2-4c5b-a744-6a4ec2c1e648 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:22.221664 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-86ba2ecd-80a2-4c5b-a744-6a4ec2c1e648 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:22.222112 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-86ba2ecd-80a2-4c5b-a744-6a4ec2c1e648 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:22.222889 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-86ba2ecd-80a2-4c5b-a744-6a4ec2c1e648 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:22.223382 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-86ba2ecd-80a2-4c5b-a744-6a4ec2c1e648 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:22.352838 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-86ba2ecd-80a2-4c5b-a744-6a4ec2c1e648 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:22.362388 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-86ba2ecd-80a2-4c5b-a744-6a4ec2c1e648 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1305 microversion: 2.1 time: 0.160116 Jun 22 18:41:22.363354 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 269/569] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:22 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1305 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:22.730092 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0ac962d2-d244-4f6d-a5eb-51fde84b901e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:22.731225 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0ac962d2-d244-4f6d-a5eb-51fde84b901e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:22.737934 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0ac962d2-d244-4f6d-a5eb-51fde84b901e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:22.738381 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0ac962d2-d244-4f6d-a5eb-51fde84b901e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:22.739135 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0ac962d2-d244-4f6d-a5eb-51fde84b901e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:22.739566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0ac962d2-d244-4f6d-a5eb-51fde84b901e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:22.875136 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0ac962d2-d244-4f6d-a5eb-51fde84b901e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:22.882866 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0ac962d2-d244-4f6d-a5eb-51fde84b901e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1367 microversion: 2.1 time: 0.157074 Jun 22 18:41:22.883423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 301/570] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:22 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:41:23.381808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-12b56c98-ad88-41ab-b7db-e370b8528c50 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:23.383046 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-12b56c98-ad88-41ab-b7db-e370b8528c50 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:23.389842 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-12b56c98-ad88-41ab-b7db-e370b8528c50 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:23.390281 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-12b56c98-ad88-41ab-b7db-e370b8528c50 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:23.391251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-12b56c98-ad88-41ab-b7db-e370b8528c50 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:23.391674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-12b56c98-ad88-41ab-b7db-e370b8528c50 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:23.478735 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-12b56c98-ad88-41ab-b7db-e370b8528c50 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:23.487693 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-12b56c98-ad88-41ab-b7db-e370b8528c50 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1303 microversion: 2.1 time: 0.110739 Jun 22 18:41:23.499235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 270/571] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:23 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:23.898350 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-76224a5a-26ec-40b2-9c9d-d605687d1be3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:23.898958 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-76224a5a-26ec-40b2-9c9d-d605687d1be3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:23.910446 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76224a5a-26ec-40b2-9c9d-d605687d1be3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:23.910896 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76224a5a-26ec-40b2-9c9d-d605687d1be3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:23.911672 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76224a5a-26ec-40b2-9c9d-d605687d1be3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:23.912124 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76224a5a-26ec-40b2-9c9d-d605687d1be3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:24.057921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-76224a5a-26ec-40b2-9c9d-d605687d1be3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:24.065495 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-76224a5a-26ec-40b2-9c9d-d605687d1be3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1367 microversion: 2.1 time: 0.170918 Jun 22 18:41:24.066066 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 302/572] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:23 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:24.375568 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1727281636", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2107367893", "security_groups": [{"name": "tempest-secgroup-smoke-1212979075"}], "block_device_mapping_v2": [{"uuid": "b97d8223-42cf-4d1b-978b-73f81be546dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd7ae770-155c-4c8d-a4ad-fa877423fa7d"}]}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:24.507384 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6f085911-0268-4abb-a9f1-d4e846d911ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:24.508034 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6f085911-0268-4abb-a9f1-d4e846d911ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:24.516257 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6f085911-0268-4abb-a9f1-d4e846d911ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:24.516704 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6f085911-0268-4abb-a9f1-d4e846d911ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:24.517475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6f085911-0268-4abb-a9f1-d4e846d911ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:24.517913 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6f085911-0268-4abb-a9f1-d4e846d911ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:24.581595 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.network.neutron [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] validate_networks() for [('fd7ae770-155c-4c8d-a4ad-fa877423fa7d', None, None, None, None, None)] {{(pid=129743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:41:24.964042 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6f085911-0268-4abb-a9f1-d4e846d911ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:24.972511 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6f085911-0268-4abb-a9f1-d4e846d911ff tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1371 microversion: 2.1 time: 0.470217 Jun 22 18:41:24.973079 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 303/573] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:24 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1371 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:24.977981 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-73366447-8c26-4586-8a9f-0426bc1aa30a req-4bc6ff14-f238-433b-9f0c-7ec50f2504ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398c2e47-c400-4fc9-9886-3bae472ef7ef", "tag": "82a54d97-7875-47e7-82fc-49324718c1f0"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:24.986743 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-73366447-8c26-4586-8a9f-0426bc1aa30a req-4bc6ff14-f238-433b-9f0c-7ec50f2504ec service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:24.987192 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-73366447-8c26-4586-8a9f-0426bc1aa30a req-4bc6ff14-f238-433b-9f0c-7ec50f2504ec service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:25.000103 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-73366447-8c26-4586-8a9f-0426bc1aa30a req-4bc6ff14-f238-433b-9f0c-7ec50f2504ec service nova] Creating event network-changed:82a54d97-7875-47e7-82fc-49324718c1f0 for instance 398c2e47-c400-4fc9-9886-3bae472ef7ef on hv-cinder-81268 Jun 22 18:41:25.004901 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-73366447-8c26-4586-8a9f-0426bc1aa30a req-4bc6ff14-f238-433b-9f0c-7ec50f2504ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030132 Jun 22 18:41:25.005807 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 304/574] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:41:25.083538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-aac575b3-4bd1-4a71-a144-2d6402294e20 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:25.084745 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-aac575b3-4bd1-4a71-a144-2d6402294e20 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:25.093022 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-aac575b3-4bd1-4a71-a144-2d6402294e20 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:25.093470 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-aac575b3-4bd1-4a71-a144-2d6402294e20 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:25.094237 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-aac575b3-4bd1-4a71-a144-2d6402294e20 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:25.094682 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-aac575b3-4bd1-4a71-a144-2d6402294e20 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:25.279430 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-aac575b3-4bd1-4a71-a144-2d6402294e20 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:25.287962 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-aac575b3-4bd1-4a71-a144-2d6402294e20 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1557 microversion: 2.1 time: 0.208737 Jun 22 18:41:25.288522 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 305/575] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:25 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1557 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:25.304609 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-37c4c049-3bbf-4556-ae97-4ed16d04cd22 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:25.305092 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-37c4c049-3bbf-4556-ae97-4ed16d04cd22 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:25.311958 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-37c4c049-3bbf-4556-ae97-4ed16d04cd22 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:25.312409 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-37c4c049-3bbf-4556-ae97-4ed16d04cd22 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:25.313171 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-37c4c049-3bbf-4556-ae97-4ed16d04cd22 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:25.313604 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-37c4c049-3bbf-4556-ae97-4ed16d04cd22 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:25.329066 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Flavor limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:41:25.329580 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Image limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:41:25.330319 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Flavor pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:41:25.330940 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Image pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:41:25.331548 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:41:25.341582 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:25.342146 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:25.343016 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:25.343526 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:25.361111 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Getting quotas for project 49c7f224d0374125ae22f576e8757f29. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:41:25.365345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Getting quotas for user 00cfbc965d934d6db28f41f8082eb5ef and project 49c7f224d0374125ae22f576e8757f29. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:41:25.397670 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-37c4c049-3bbf-4556-ae97-4ed16d04cd22 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096850 Jun 22 18:41:25.398760 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 306/576] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 18:41:25 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:41:25.436319 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Going to run 1 instances... {{(pid=129743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:41:25.438383 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b97d8223-42cf-4d1b-978b-73f81be546dc',volume_size=None,volume_type=None)] {{(pid=129743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:41:25.612182 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e045978a-584a-4eab-92de-0b4c62b4b49d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.240627 Jun 22 18:41:25.613819 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 271/577] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:41:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:41:25.623302 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-de90ed00-b07e-451e-b92a-0f862fad0288 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:25.624097 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-de90ed00-b07e-451e-b92a-0f862fad0288 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:25.703961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 18:41:25.704429 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Wed Jun 22 18:41:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 18:41:25.762219 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-de90ed00-b07e-451e-b92a-0f862fad0288 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:25.770353 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-de90ed00-b07e-451e-b92a-0f862fad0288 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1095 microversion: 2.1 time: 0.150648 Jun 22 18:41:25.781045 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 307/578] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:25 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1095 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:25.993497 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a15b32b9-5a51-406b-b00c-5eb95f4ac16c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:25.994283 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a15b32b9-5a51-406b-b00c-5eb95f4ac16c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:26.013781 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a15b32b9-5a51-406b-b00c-5eb95f4ac16c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:26.017179 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a15b32b9-5a51-406b-b00c-5eb95f4ac16c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:26.018447 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a15b32b9-5a51-406b-b00c-5eb95f4ac16c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:26.020970 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a15b32b9-5a51-406b-b00c-5eb95f4ac16c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:26.238244 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a15b32b9-5a51-406b-b00c-5eb95f4ac16c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:26.248455 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a15b32b9-5a51-406b-b00c-5eb95f4ac16c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1371 microversion: 2.1 time: 0.262159 Jun 22 18:41:26.249512 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 272/579] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:25 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:26.787901 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-53ab600e-8cbc-48c9-9e29-ca964569819e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:26.788581 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-53ab600e-8cbc-48c9-9e29-ca964569819e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:26.789935 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-c67fc3a1-9c2b-4864-8338-f23d46c7222d req-2952f6dc-4ac8-41d6-9888-adff071e915a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc", "tag": "fe5449d7-e40a-4798-93d2-909f1771b70d"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:26.803962 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-53ab600e-8cbc-48c9-9e29-ca964569819e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:26.803962 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-53ab600e-8cbc-48c9-9e29-ca964569819e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:26.804839 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-53ab600e-8cbc-48c9-9e29-ca964569819e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:26.806468 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-c67fc3a1-9c2b-4864-8338-f23d46c7222d req-2952f6dc-4ac8-41d6-9888-adff071e915a service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:26.807139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-53ab600e-8cbc-48c9-9e29-ca964569819e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:26.814202 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-c67fc3a1-9c2b-4864-8338-f23d46c7222d req-2952f6dc-4ac8-41d6-9888-adff071e915a service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:26.835223 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-c67fc3a1-9c2b-4864-8338-f23d46c7222d req-2952f6dc-4ac8-41d6-9888-adff071e915a service nova] Creating event network-changed:fe5449d7-e40a-4798-93d2-909f1771b70d for instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc on hv-cinder-81268 Jun 22 18:41:26.842738 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-c67fc3a1-9c2b-4864-8338-f23d46c7222d req-2952f6dc-4ac8-41d6-9888-adff071e915a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063284 Jun 22 18:41:26.843626 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 308/580] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:41:26.880318 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-53ab600e-8cbc-48c9-9e29-ca964569819e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:26.890902 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-53ab600e-8cbc-48c9-9e29-ca964569819e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1145 microversion: 2.1 time: 0.107301 Jun 22 18:41:26.892453 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 273/581] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:26 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1145 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:41:27.267762 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-775be301-021b-4576-addd-40d9b7df1803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:27.270204 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-775be301-021b-4576-addd-40d9b7df1803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:27.281953 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-775be301-021b-4576-addd-40d9b7df1803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:27.282405 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-775be301-021b-4576-addd-40d9b7df1803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:27.283189 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-775be301-021b-4576-addd-40d9b7df1803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:27.284051 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-775be301-021b-4576-addd-40d9b7df1803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:27.444085 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-775be301-021b-4576-addd-40d9b7df1803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:27.451474 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-775be301-021b-4576-addd-40d9b7df1803 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1371 microversion: 2.1 time: 0.189318 Jun 22 18:41:27.459756 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 309/582] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:27 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:27.910048 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-af7a3e56-9ce6-4758-a852-9601e836170e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:27.910793 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-af7a3e56-9ce6-4758-a852-9601e836170e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:27.917408 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-af7a3e56-9ce6-4758-a852-9601e836170e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:27.917859 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-af7a3e56-9ce6-4758-a852-9601e836170e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:27.919778 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-af7a3e56-9ce6-4758-a852-9601e836170e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:27.920252 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-af7a3e56-9ce6-4758-a852-9601e836170e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:27.983152 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-af7a3e56-9ce6-4758-a852-9601e836170e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:27.990780 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-af7a3e56-9ce6-4758-a852-9601e836170e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1145 microversion: 2.1 time: 0.086175 Jun 22 18:41:27.991333 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 274/583] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:27 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:41:28.473969 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-41dce7ab-4374-4bbd-a745-75dac79157bb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:28.474622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-41dce7ab-4374-4bbd-a745-75dac79157bb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:28.482854 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-41dce7ab-4374-4bbd-a745-75dac79157bb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:28.483758 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-41dce7ab-4374-4bbd-a745-75dac79157bb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:28.484777 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-41dce7ab-4374-4bbd-a745-75dac79157bb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:28.485542 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-41dce7ab-4374-4bbd-a745-75dac79157bb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:28.643384 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-41dce7ab-4374-4bbd-a745-75dac79157bb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:28.650827 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-41dce7ab-4374-4bbd-a745-75dac79157bb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1371 microversion: 2.1 time: 0.182182 Jun 22 18:41:28.651391 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 310/584] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:28 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:29.007796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6d20b8a1-a26d-4e55-9645-ca623a65565c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:29.011316 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6d20b8a1-a26d-4e55-9645-ca623a65565c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:29.021026 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6d20b8a1-a26d-4e55-9645-ca623a65565c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:29.021704 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6d20b8a1-a26d-4e55-9645-ca623a65565c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:29.022698 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6d20b8a1-a26d-4e55-9645-ca623a65565c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:29.023387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6d20b8a1-a26d-4e55-9645-ca623a65565c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:29.180043 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6d20b8a1-a26d-4e55-9645-ca623a65565c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:29.190413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6d20b8a1-a26d-4e55-9645-ca623a65565c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1211 microversion: 2.1 time: 0.186187 Jun 22 18:41:29.191701 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 275/585] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:29 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1211 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:29.668158 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d6972041-331f-41b4-a3b7-689bf76e83f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:29.668753 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d6972041-331f-41b4-a3b7-689bf76e83f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:29.679915 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d6972041-331f-41b4-a3b7-689bf76e83f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:29.680369 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d6972041-331f-41b4-a3b7-689bf76e83f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:29.681340 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d6972041-331f-41b4-a3b7-689bf76e83f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:29.692634 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d6972041-331f-41b4-a3b7-689bf76e83f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:29.697275 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=100 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:29.890422 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d6972041-331f-41b4-a3b7-689bf76e83f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:29.900645 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d6972041-331f-41b4-a3b7-689bf76e83f1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1371 microversion: 2.1 time: 0.236173 Jun 22 18:41:29.901852 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 311/586] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:29 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:30.209809 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bf5cd913-07cb-4ccd-b15b-353768a0f444 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:30.210416 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bf5cd913-07cb-4ccd-b15b-353768a0f444 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:30.217366 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bf5cd913-07cb-4ccd-b15b-353768a0f444 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:30.217804 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bf5cd913-07cb-4ccd-b15b-353768a0f444 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:30.218565 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bf5cd913-07cb-4ccd-b15b-353768a0f444 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:30.218994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bf5cd913-07cb-4ccd-b15b-353768a0f444 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:30.292556 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bf5cd913-07cb-4ccd-b15b-353768a0f444 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:30.301970 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bf5cd913-07cb-4ccd-b15b-353768a0f444 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1199 microversion: 2.1 time: 0.095800 Jun 22 18:41:30.303510 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 276/587] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:30 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1199 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:30.918605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-06cef0e8-23e9-4f56-9380-d05f29d236fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:30.920030 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-06cef0e8-23e9-4f56-9380-d05f29d236fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:30.927792 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-06cef0e8-23e9-4f56-9380-d05f29d236fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:30.928286 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-06cef0e8-23e9-4f56-9380-d05f29d236fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:30.929257 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-06cef0e8-23e9-4f56-9380-d05f29d236fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:30.929984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-06cef0e8-23e9-4f56-9380-d05f29d236fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:31.077993 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-06cef0e8-23e9-4f56-9380-d05f29d236fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:31.086342 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-06cef0e8-23e9-4f56-9380-d05f29d236fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1371 microversion: 2.1 time: 0.172178 Jun 22 18:41:31.086904 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 312/588] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:30 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:31.139766 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-8ae86847-10c5-4610-99b8-87b9711c7bd4 req-2a87188a-43b7-406c-b50c-ec5fb736b37f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2394525-6da9-4670-a17a-392e0c892204", "tag": "8f63903e-463c-40f2-b578-98eaa2629dc7"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:31.148940 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-8ae86847-10c5-4610-99b8-87b9711c7bd4 req-2a87188a-43b7-406c-b50c-ec5fb736b37f service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:31.149297 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-8ae86847-10c5-4610-99b8-87b9711c7bd4 req-2a87188a-43b7-406c-b50c-ec5fb736b37f service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:31.161710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-8ae86847-10c5-4610-99b8-87b9711c7bd4 req-2a87188a-43b7-406c-b50c-ec5fb736b37f service nova] Creating event network-changed:8f63903e-463c-40f2-b578-98eaa2629dc7 for instance e2394525-6da9-4670-a17a-392e0c892204 on hv-cinder-81268 Jun 22 18:41:31.166914 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-8ae86847-10c5-4610-99b8-87b9711c7bd4 req-2a87188a-43b7-406c-b50c-ec5fb736b37f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032486 Jun 22 18:41:31.168579 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 277/589] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:41:31.320342 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2003152d-de2b-49b7-bb1d-5ad382eaa6ae tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:31.320950 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2003152d-de2b-49b7-bb1d-5ad382eaa6ae tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:31.329108 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2003152d-de2b-49b7-bb1d-5ad382eaa6ae tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:31.329487 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2003152d-de2b-49b7-bb1d-5ad382eaa6ae tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:31.330443 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2003152d-de2b-49b7-bb1d-5ad382eaa6ae tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:31.330880 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2003152d-de2b-49b7-bb1d-5ad382eaa6ae tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:31.469198 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-2003152d-de2b-49b7-bb1d-5ad382eaa6ae tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:31.477332 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2003152d-de2b-49b7-bb1d-5ad382eaa6ae tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1267 microversion: 2.1 time: 0.160804 Jun 22 18:41:31.477931 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 313/590] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:31 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:31.821911 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-7bf7e259-0733-42c3-b109-e67448e80405 req-155581e9-707b-4da7-afc8-e5df01bd1129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398c2e47-c400-4fc9-9886-3bae472ef7ef", "name": "network-vif-plugged", "status": "completed", "tag": "82a54d97-7875-47e7-82fc-49324718c1f0"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:31.834326 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-7bf7e259-0733-42c3-b109-e67448e80405 req-155581e9-707b-4da7-afc8-e5df01bd1129 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:31.835236 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-7bf7e259-0733-42c3-b109-e67448e80405 req-155581e9-707b-4da7-afc8-e5df01bd1129 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:31.849372 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-7bf7e259-0733-42c3-b109-e67448e80405 req-155581e9-707b-4da7-afc8-e5df01bd1129 service nova] Creating event network-vif-plugged:82a54d97-7875-47e7-82fc-49324718c1f0 for instance 398c2e47-c400-4fc9-9886-3bae472ef7ef on hv-cinder-81268 Jun 22 18:41:31.854404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-7bf7e259-0733-42c3-b109-e67448e80405 req-155581e9-707b-4da7-afc8-e5df01bd1129 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036759 Jun 22 18:41:31.855775 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 278/591] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:41:32.102620 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3f1a6b33-17e2-498a-9ac8-3087ce5cbbeb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:32.103222 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3f1a6b33-17e2-498a-9ac8-3087ce5cbbeb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:32.109892 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3f1a6b33-17e2-498a-9ac8-3087ce5cbbeb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:32.110337 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3f1a6b33-17e2-498a-9ac8-3087ce5cbbeb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:32.111097 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3f1a6b33-17e2-498a-9ac8-3087ce5cbbeb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:32.111533 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3f1a6b33-17e2-498a-9ac8-3087ce5cbbeb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:32.244758 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3f1a6b33-17e2-498a-9ac8-3087ce5cbbeb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:32.253948 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3f1a6b33-17e2-498a-9ac8-3087ce5cbbeb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1371 microversion: 2.1 time: 0.155064 Jun 22 18:41:32.254606 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 314/592] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:32 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:32.494859 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c178f62b-3c6e-4b3d-92eb-e401f172c174 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:32.495543 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c178f62b-3c6e-4b3d-92eb-e401f172c174 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:32.502399 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c178f62b-3c6e-4b3d-92eb-e401f172c174 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:32.502845 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c178f62b-3c6e-4b3d-92eb-e401f172c174 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:32.503667 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c178f62b-3c6e-4b3d-92eb-e401f172c174 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:32.504125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c178f62b-3c6e-4b3d-92eb-e401f172c174 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:32.718277 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c178f62b-3c6e-4b3d-92eb-e401f172c174 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:32.726037 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c178f62b-3c6e-4b3d-92eb-e401f172c174 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1267 microversion: 2.1 time: 0.235345 Jun 22 18:41:32.726706 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 279/593] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:32 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:33.271645 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0b24e4a1-2b8f-4ee5-b520-a516fd60225f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:33.272363 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0b24e4a1-2b8f-4ee5-b520-a516fd60225f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:33.279233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0b24e4a1-2b8f-4ee5-b520-a516fd60225f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:33.279678 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0b24e4a1-2b8f-4ee5-b520-a516fd60225f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:33.280467 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0b24e4a1-2b8f-4ee5-b520-a516fd60225f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:33.280994 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0b24e4a1-2b8f-4ee5-b520-a516fd60225f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:33.409657 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0b24e4a1-2b8f-4ee5-b520-a516fd60225f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:33.417133 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0b24e4a1-2b8f-4ee5-b520-a516fd60225f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1371 microversion: 2.1 time: 0.149253 Jun 22 18:41:33.417695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 315/594] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:33 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:33.742896 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-9dc333e8-7383-4dff-b2fd-d5b855fcece1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:33.743505 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-9dc333e8-7383-4dff-b2fd-d5b855fcece1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:33.750975 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9dc333e8-7383-4dff-b2fd-d5b855fcece1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:33.751468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9dc333e8-7383-4dff-b2fd-d5b855fcece1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:33.752331 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9dc333e8-7383-4dff-b2fd-d5b855fcece1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:33.752828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9dc333e8-7383-4dff-b2fd-d5b855fcece1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:33.757706 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:33.895296 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-9dc333e8-7383-4dff-b2fd-d5b855fcece1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:33.903299 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-9dc333e8-7383-4dff-b2fd-d5b855fcece1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1267 microversion: 2.1 time: 0.164247 Jun 22 18:41:33.904051 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 280/595] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:33 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:34.434246 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5a616d44-e669-4754-ad1f-68fbad192ba4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:34.434879 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5a616d44-e669-4754-ad1f-68fbad192ba4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:34.440871 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5a616d44-e669-4754-ad1f-68fbad192ba4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:34.441317 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5a616d44-e669-4754-ad1f-68fbad192ba4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:34.442104 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5a616d44-e669-4754-ad1f-68fbad192ba4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:34.442535 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5a616d44-e669-4754-ad1f-68fbad192ba4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:34.577396 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5a616d44-e669-4754-ad1f-68fbad192ba4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:34.584987 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5a616d44-e669-4754-ad1f-68fbad192ba4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1371 microversion: 2.1 time: 0.155122 Jun 22 18:41:34.585584 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 316/596] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:34 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:34.920611 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1ae1c61e-0965-4fef-be09-dfd35a27c801 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:34.921124 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1ae1c61e-0965-4fef-be09-dfd35a27c801 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:34.927486 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1ae1c61e-0965-4fef-be09-dfd35a27c801 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:34.927954 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1ae1c61e-0965-4fef-be09-dfd35a27c801 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:34.928703 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1ae1c61e-0965-4fef-be09-dfd35a27c801 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:34.929131 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1ae1c61e-0965-4fef-be09-dfd35a27c801 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:35.061363 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1ae1c61e-0965-4fef-be09-dfd35a27c801 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:35.068795 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1ae1c61e-0965-4fef-be09-dfd35a27c801 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1267 microversion: 2.1 time: 0.152649 Jun 22 18:41:35.069358 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 281/597] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:34 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:35.602228 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b7eed0ec-e0ce-461f-ba72-e077d04dde94 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:35.602840 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b7eed0ec-e0ce-461f-ba72-e077d04dde94 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:35.609106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b7eed0ec-e0ce-461f-ba72-e077d04dde94 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:35.609560 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b7eed0ec-e0ce-461f-ba72-e077d04dde94 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:35.610321 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b7eed0ec-e0ce-461f-ba72-e077d04dde94 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:35.610778 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b7eed0ec-e0ce-461f-ba72-e077d04dde94 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:35.747514 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b7eed0ec-e0ce-461f-ba72-e077d04dde94 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:35.755252 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b7eed0ec-e0ce-461f-ba72-e077d04dde94 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1564 microversion: 2.1 time: 0.157238 Jun 22 18:41:35.755823 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 317/598] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:35 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:35.772269 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5f494c87-83cd-4df4-919c-a4b3c7636e3e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:35.772764 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5f494c87-83cd-4df4-919c-a4b3c7636e3e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:35.774606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=4 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:35.775350 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=12 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:35.781370 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5f494c87-83cd-4df4-919c-a4b3c7636e3e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:35.781856 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5f494c87-83cd-4df4-919c-a4b3c7636e3e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:35.782578 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5f494c87-83cd-4df4-919c-a4b3c7636e3e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:35.783053 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5f494c87-83cd-4df4-919c-a4b3c7636e3e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:35.859705 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5f494c87-83cd-4df4-919c-a4b3c7636e3e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091203 Jun 22 18:41:35.860501 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 282/599] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 18:41:35 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:41:36.085780 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0360d3c1-f90e-400f-947e-7b4ff135b5bf tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:36.086373 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0360d3c1-f90e-400f-947e-7b4ff135b5bf tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:36.088402 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=8 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:36.093945 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0360d3c1-f90e-400f-947e-7b4ff135b5bf tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:36.094387 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0360d3c1-f90e-400f-947e-7b4ff135b5bf tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:36.095157 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0360d3c1-f90e-400f-947e-7b4ff135b5bf tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:36.095583 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0360d3c1-f90e-400f-947e-7b4ff135b5bf tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:36.342913 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0360d3c1-f90e-400f-947e-7b4ff135b5bf tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:36.350341 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0360d3c1-f90e-400f-947e-7b4ff135b5bf tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1267 microversion: 2.1 time: 0.268450 Jun 22 18:41:36.350904 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 318/600] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:36 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:37.067248 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-bdebe3fe-8a96-4ebd-bfed-15962d0c3d64 req-563121c9-0803-43a9-954e-a147eba8ff32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398c2e47-c400-4fc9-9886-3bae472ef7ef", "tag": "82a54d97-7875-47e7-82fc-49324718c1f0"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:37.075785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-bdebe3fe-8a96-4ebd-bfed-15962d0c3d64 req-563121c9-0803-43a9-954e-a147eba8ff32 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:37.076329 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-bdebe3fe-8a96-4ebd-bfed-15962d0c3d64 req-563121c9-0803-43a9-954e-a147eba8ff32 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:37.087864 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-bdebe3fe-8a96-4ebd-bfed-15962d0c3d64 req-563121c9-0803-43a9-954e-a147eba8ff32 service nova] Creating event network-changed:82a54d97-7875-47e7-82fc-49324718c1f0 for instance 398c2e47-c400-4fc9-9886-3bae472ef7ef on hv-cinder-81268 Jun 22 18:41:37.093164 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-bdebe3fe-8a96-4ebd-bfed-15962d0c3d64 req-563121c9-0803-43a9-954e-a147eba8ff32 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030391 Jun 22 18:41:37.093745 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 283/601] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:41:37.366767 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8a1b45f2-7f07-4dce-947e-db49b900643c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:37.367395 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8a1b45f2-7f07-4dce-947e-db49b900643c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:37.375129 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8a1b45f2-7f07-4dce-947e-db49b900643c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:37.375579 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8a1b45f2-7f07-4dce-947e-db49b900643c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:37.376371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8a1b45f2-7f07-4dce-947e-db49b900643c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:37.376804 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8a1b45f2-7f07-4dce-947e-db49b900643c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:37.524124 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8a1b45f2-7f07-4dce-947e-db49b900643c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:37.534084 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8a1b45f2-7f07-4dce-947e-db49b900643c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1267 microversion: 2.1 time: 0.171259 Jun 22 18:41:37.534863 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 319/602] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:37 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:38.553383 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-8d969086-6ee9-4734-8876-cfc55c7d1752 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:38.553989 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-8d969086-6ee9-4734-8876-cfc55c7d1752 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:38.561215 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8d969086-6ee9-4734-8876-cfc55c7d1752 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:38.561656 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8d969086-6ee9-4734-8876-cfc55c7d1752 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:38.562425 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8d969086-6ee9-4734-8876-cfc55c7d1752 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:38.562851 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8d969086-6ee9-4734-8876-cfc55c7d1752 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:38.701350 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-8d969086-6ee9-4734-8876-cfc55c7d1752 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:38.708756 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-8d969086-6ee9-4734-8876-cfc55c7d1752 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1267 microversion: 2.1 time: 0.160609 Jun 22 18:41:38.709306 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 284/603] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:38 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:41:39.726514 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cc87707f-de6b-4a2a-9e11-685c8da96e6e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:39.727124 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cc87707f-de6b-4a2a-9e11-685c8da96e6e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:39.734174 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc87707f-de6b-4a2a-9e11-685c8da96e6e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:39.734622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc87707f-de6b-4a2a-9e11-685c8da96e6e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:39.735389 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc87707f-de6b-4a2a-9e11-685c8da96e6e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:39.735822 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc87707f-de6b-4a2a-9e11-685c8da96e6e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:39.873633 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cc87707f-de6b-4a2a-9e11-685c8da96e6e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:39.881521 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cc87707f-de6b-4a2a-9e11-685c8da96e6e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1267 microversion: 2.1 time: 0.158617 Jun 22 18:41:39.882083 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 320/604] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:39 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:40.898432 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3e345ae2-dc1b-4d4a-aba1-eeb080323a35 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:40.899028 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3e345ae2-dc1b-4d4a-aba1-eeb080323a35 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:40.906243 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3e345ae2-dc1b-4d4a-aba1-eeb080323a35 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:40.906682 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3e345ae2-dc1b-4d4a-aba1-eeb080323a35 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:40.907466 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3e345ae2-dc1b-4d4a-aba1-eeb080323a35 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:40.907920 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3e345ae2-dc1b-4d4a-aba1-eeb080323a35 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:41.037310 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3e345ae2-dc1b-4d4a-aba1-eeb080323a35 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:41.044839 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3e345ae2-dc1b-4d4a-aba1-eeb080323a35 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1267 microversion: 2.1 time: 0.150255 Jun 22 18:41:41.045414 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 285/605] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:40 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:41.874308 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-4201a4e4-03e8-4c82-94fc-c1a1bc624b34 req-75513e57-f54d-459f-b65d-0d525c1b982a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2394525-6da9-4670-a17a-392e0c892204", "name": "network-vif-plugged", "status": "completed", "tag": "8f63903e-463c-40f2-b578-98eaa2629dc7"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:41.877971 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:41.883987 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-4201a4e4-03e8-4c82-94fc-c1a1bc624b34 req-75513e57-f54d-459f-b65d-0d525c1b982a service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:41.884533 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-4201a4e4-03e8-4c82-94fc-c1a1bc624b34 req-75513e57-f54d-459f-b65d-0d525c1b982a service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:41.898293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-4201a4e4-03e8-4c82-94fc-c1a1bc624b34 req-75513e57-f54d-459f-b65d-0d525c1b982a service nova] Creating event network-vif-plugged:8f63903e-463c-40f2-b578-98eaa2629dc7 for instance e2394525-6da9-4670-a17a-392e0c892204 on hv-cinder-81268 Jun 22 18:41:41.903343 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-4201a4e4-03e8-4c82-94fc-c1a1bc624b34 req-75513e57-f54d-459f-b65d-0d525c1b982a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033168 Jun 22 18:41:41.904207 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 321/606] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:41:42.061678 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4ad18b07-e6c3-4562-95aa-f5786b936771 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:42.063104 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-4ad18b07-e6c3-4562-95aa-f5786b936771 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:42.070591 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4ad18b07-e6c3-4562-95aa-f5786b936771 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:42.071265 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4ad18b07-e6c3-4562-95aa-f5786b936771 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:42.072137 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4ad18b07-e6c3-4562-95aa-f5786b936771 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:42.072570 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4ad18b07-e6c3-4562-95aa-f5786b936771 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:42.279521 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4ad18b07-e6c3-4562-95aa-f5786b936771 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:42.290191 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4ad18b07-e6c3-4562-95aa-f5786b936771 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1267 microversion: 2.1 time: 0.232381 Jun 22 18:41:42.291078 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 286/607] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:42 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:43.307775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ec85a68f-0c88-4089-a804-37f55509b74d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:43.308496 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ec85a68f-0c88-4089-a804-37f55509b74d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:43.314867 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ec85a68f-0c88-4089-a804-37f55509b74d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:43.315306 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ec85a68f-0c88-4089-a804-37f55509b74d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:43.316088 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ec85a68f-0c88-4089-a804-37f55509b74d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:43.316516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ec85a68f-0c88-4089-a804-37f55509b74d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:43.445476 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ec85a68f-0c88-4089-a804-37f55509b74d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:43.453143 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ec85a68f-0c88-4089-a804-37f55509b74d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1267 microversion: 2.1 time: 0.149676 Jun 22 18:41:43.453742 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 322/608] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:43 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:44.469004 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d30801dc-5e92-4591-b5ef-d02a94852460 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:44.469534 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d30801dc-5e92-4591-b5ef-d02a94852460 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:44.476072 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d30801dc-5e92-4591-b5ef-d02a94852460 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:44.476517 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d30801dc-5e92-4591-b5ef-d02a94852460 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:44.477271 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d30801dc-5e92-4591-b5ef-d02a94852460 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:44.477704 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d30801dc-5e92-4591-b5ef-d02a94852460 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:44.514903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d6bf4de2-41b2-4acf-8a79-1524751cdd35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:44.515495 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d6bf4de2-41b2-4acf-8a79-1524751cdd35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:44.522248 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d6bf4de2-41b2-4acf-8a79-1524751cdd35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:44.522695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d6bf4de2-41b2-4acf-8a79-1524751cdd35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:44.523477 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d6bf4de2-41b2-4acf-8a79-1524751cdd35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:44.523933 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d6bf4de2-41b2-4acf-8a79-1524751cdd35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:44.552958 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d6bf4de2-41b2-4acf-8a79-1524751cdd35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/ips" status: 200 len: 151 microversion: 2.20 time: 0.043141 Jun 22 18:41:44.553852 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 323/609] 10.222.0.18 () {60 vars in 1288 bytes} [Wed Jun 22 18:41:44 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:41:44.622933 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d30801dc-5e92-4591-b5ef-d02a94852460 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:44.630465 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d30801dc-5e92-4591-b5ef-d02a94852460 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1267 microversion: 2.1 time: 0.165442 Jun 22 18:41:44.631275 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 287/610] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:44 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:45.648375 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a8161d80-3a87-44be-981f-d613375631b9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:45.648987 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a8161d80-3a87-44be-981f-d613375631b9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:45.655613 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a8161d80-3a87-44be-981f-d613375631b9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:45.656280 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a8161d80-3a87-44be-981f-d613375631b9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:45.656868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a8161d80-3a87-44be-981f-d613375631b9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:45.657305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a8161d80-3a87-44be-981f-d613375631b9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:45.810155 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a8161d80-3a87-44be-981f-d613375631b9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:45.817921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a8161d80-3a87-44be-981f-d613375631b9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1454 microversion: 2.1 time: 0.173348 Jun 22 18:41:45.818470 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 324/611] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:45 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:45.836990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-de78276f-000e-4604-bbd8-45d7619f47c7 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:45.837623 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-de78276f-000e-4604-bbd8-45d7619f47c7 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:45.847501 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de78276f-000e-4604-bbd8-45d7619f47c7 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:45.848075 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de78276f-000e-4604-bbd8-45d7619f47c7 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:45.849359 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de78276f-000e-4604-bbd8-45d7619f47c7 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:45.849830 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de78276f-000e-4604-bbd8-45d7619f47c7 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:45.995393 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-de78276f-000e-4604-bbd8-45d7619f47c7 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:46.006799 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-de78276f-000e-4604-bbd8-45d7619f47c7 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1454 microversion: 2.1 time: 0.174307 Jun 22 18:41:46.007404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 288/612] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:45 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:47.114883 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9336771f-85c2-4726-9fca-336c1e6ce208 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:47.115461 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9336771f-85c2-4726-9fca-336c1e6ce208 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:47.121422 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9336771f-85c2-4726-9fca-336c1e6ce208 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:47.121866 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9336771f-85c2-4726-9fca-336c1e6ce208 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:47.123124 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9336771f-85c2-4726-9fca-336c1e6ce208 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:47.123557 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9336771f-85c2-4726-9fca-336c1e6ce208 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:47.147812 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-9336771f-85c2-4726-9fca-336c1e6ce208 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lazy-loading 'flavor' on Instance uuid 688c6da6-d454-4dc0-8335-b0a4e16f5824 {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:41:47.420169 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9336771f-85c2-4726-9fca-336c1e6ce208 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "POST /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/action" status: 202 len: 0 microversion: 2.20 time: 0.308213 Jun 22 18:41:47.423730 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 325/613] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jun 22 18:41:47 2022] POST /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:41:47.429073 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d565cb6c-2a49-4da5-9603-e2637001582d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:47.429762 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d565cb6c-2a49-4da5-9603-e2637001582d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:47.437074 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d565cb6c-2a49-4da5-9603-e2637001582d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:47.437974 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d565cb6c-2a49-4da5-9603-e2637001582d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:47.438990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d565cb6c-2a49-4da5-9603-e2637001582d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:47.439456 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d565cb6c-2a49-4da5-9603-e2637001582d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:47.522672 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cd781289-eccb-4a1c-988d-ba6196234dfd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:47.523251 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cd781289-eccb-4a1c-988d-ba6196234dfd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:47.530515 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cd781289-eccb-4a1c-988d-ba6196234dfd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:47.530968 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cd781289-eccb-4a1c-988d-ba6196234dfd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:47.531753 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cd781289-eccb-4a1c-988d-ba6196234dfd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:47.532218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cd781289-eccb-4a1c-988d-ba6196234dfd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:47.557855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cd781289-eccb-4a1c-988d-ba6196234dfd tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/ips" status: 200 len: 145 microversion: 2.1 time: 0.039382 Jun 22 18:41:47.558432 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 326/614] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 18:41:47 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:41:47.585554 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d565cb6c-2a49-4da5-9603-e2637001582d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:47.595080 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d565cb6c-2a49-4da5-9603-e2637001582d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:47.596728 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d565cb6c-2a49-4da5-9603-e2637001582d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:47.598177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d565cb6c-2a49-4da5-9603-e2637001582d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.172996 Jun 22 18:41:47.598820 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 289/615] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:41:47 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:41:47.707477 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-d5814ba6-3bfa-45b5-9dd7-0622773f6768 req-b635bbff-7bb2-4ce3-8a08-6650602fd61b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2394525-6da9-4670-a17a-392e0c892204", "tag": "8f63903e-463c-40f2-b578-98eaa2629dc7"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:47.715718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-d5814ba6-3bfa-45b5-9dd7-0622773f6768 req-b635bbff-7bb2-4ce3-8a08-6650602fd61b service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:47.716803 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-d5814ba6-3bfa-45b5-9dd7-0622773f6768 req-b635bbff-7bb2-4ce3-8a08-6650602fd61b service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:47.720864 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:47.728965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-d5814ba6-3bfa-45b5-9dd7-0622773f6768 req-b635bbff-7bb2-4ce3-8a08-6650602fd61b service nova] Creating event network-changed:8f63903e-463c-40f2-b578-98eaa2629dc7 for instance e2394525-6da9-4670-a17a-392e0c892204 on hv-cinder-81268 Jun 22 18:41:47.733991 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-d5814ba6-3bfa-45b5-9dd7-0622773f6768 req-b635bbff-7bb2-4ce3-8a08-6650602fd61b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030040 Jun 22 18:41:47.734668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 327/616] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:41:48.617343 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-15b9d263-05b2-4b59-bb86-352bbc961936 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:48.618104 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-15b9d263-05b2-4b59-bb86-352bbc961936 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:48.625665 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-15b9d263-05b2-4b59-bb86-352bbc961936 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:48.626231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-15b9d263-05b2-4b59-bb86-352bbc961936 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:48.627110 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-15b9d263-05b2-4b59-bb86-352bbc961936 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:48.627680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-15b9d263-05b2-4b59-bb86-352bbc961936 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:48.786932 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-15b9d263-05b2-4b59-bb86-352bbc961936 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:48.796280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-15b9d263-05b2-4b59-bb86-352bbc961936 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:48.797834 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-15b9d263-05b2-4b59-bb86-352bbc961936 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:48.798988 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-15b9d263-05b2-4b59-bb86-352bbc961936 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.186197 Jun 22 18:41:48.799527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 290/617] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:41:48 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:41:49.818122 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-090eaf44-c585-45e3-9bc3-3f5727084f86 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:49.818925 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-090eaf44-c585-45e3-9bc3-3f5727084f86 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:49.826491 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-090eaf44-c585-45e3-9bc3-3f5727084f86 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:49.826944 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-090eaf44-c585-45e3-9bc3-3f5727084f86 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:49.827713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-090eaf44-c585-45e3-9bc3-3f5727084f86 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:49.828174 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-090eaf44-c585-45e3-9bc3-3f5727084f86 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:49.832887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-96c1e10f-4dcb-490c-9487-de3c070a566a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1abbdb0-343c-464c-8529-d11a87afc62a"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:49.833997 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-96c1e10f-4dcb-490c-9487-de3c070a566a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:49.840315 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-96c1e10f-4dcb-490c-9487-de3c070a566a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:49.840939 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-96c1e10f-4dcb-490c-9487-de3c070a566a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:49.842057 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-96c1e10f-4dcb-490c-9487-de3c070a566a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:49.842807 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-96c1e10f-4dcb-490c-9487-de3c070a566a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:49.974566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-090eaf44-c585-45e3-9bc3-3f5727084f86 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:49.983477 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-090eaf44-c585-45e3-9bc3-3f5727084f86 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:49.985133 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-090eaf44-c585-45e3-9bc3-3f5727084f86 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:49.986359 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-090eaf44-c585-45e3-9bc3-3f5727084f86 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.172599 Jun 22 18:41:49.994764 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 328/618] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:41:49 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:41:50.087173 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-96c1e10f-4dcb-490c-9487-de3c070a566a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "POST /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258011 Jun 22 18:41:50.087778 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 291/619] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:41:49 2022] POST /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:41:51.004598 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-fb2c68c8-9ea0-4790-b7e9-8756718dd88d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:51.005200 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-fb2c68c8-9ea0-4790-b7e9-8756718dd88d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:51.011710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fb2c68c8-9ea0-4790-b7e9-8756718dd88d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:51.012183 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fb2c68c8-9ea0-4790-b7e9-8756718dd88d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:51.013165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fb2c68c8-9ea0-4790-b7e9-8756718dd88d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:51.013592 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fb2c68c8-9ea0-4790-b7e9-8756718dd88d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:51.139660 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fb2c68c8-9ea0-4790-b7e9-8756718dd88d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:51.147621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fb2c68c8-9ea0-4790-b7e9-8756718dd88d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:51.149155 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fb2c68c8-9ea0-4790-b7e9-8756718dd88d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:51.150284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-fb2c68c8-9ea0-4790-b7e9-8756718dd88d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.149600 Jun 22 18:41:51.150820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 329/620] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:41:50 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:41:52.170552 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-851ee4b9-6344-4b18-9a78-c50242ae9c52 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:52.171162 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-851ee4b9-6344-4b18-9a78-c50242ae9c52 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:52.173181 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:52.178925 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-851ee4b9-6344-4b18-9a78-c50242ae9c52 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:52.179375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-851ee4b9-6344-4b18-9a78-c50242ae9c52 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:52.180177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-851ee4b9-6344-4b18-9a78-c50242ae9c52 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:52.180612 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-851ee4b9-6344-4b18-9a78-c50242ae9c52 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:52.318137 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-851ee4b9-6344-4b18-9a78-c50242ae9c52 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:52.326736 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-851ee4b9-6344-4b18-9a78-c50242ae9c52 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:52.328255 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-851ee4b9-6344-4b18-9a78-c50242ae9c52 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:52.329424 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-851ee4b9-6344-4b18-9a78-c50242ae9c52 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.164020 Jun 22 18:41:52.329974 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 292/621] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:41:52 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:41:53.346998 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-641a181c-1b8c-47f2-84b8-aad3e98696b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:53.347619 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-641a181c-1b8c-47f2-84b8-aad3e98696b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:53.353673 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-641a181c-1b8c-47f2-84b8-aad3e98696b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:53.354115 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-641a181c-1b8c-47f2-84b8-aad3e98696b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:53.354862 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-641a181c-1b8c-47f2-84b8-aad3e98696b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:53.355287 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-641a181c-1b8c-47f2-84b8-aad3e98696b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:53.482531 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-641a181c-1b8c-47f2-84b8-aad3e98696b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:53.490429 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-641a181c-1b8c-47f2-84b8-aad3e98696b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:53.491958 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-641a181c-1b8c-47f2-84b8-aad3e98696b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:53.493082 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-641a181c-1b8c-47f2-84b8-aad3e98696b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.149936 Jun 22 18:41:53.493624 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 330/622] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:41:53 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:41:54.511403 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b8772865-c1bf-4ff5-a75a-f588ef6b34c4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:54.512043 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b8772865-c1bf-4ff5-a75a-f588ef6b34c4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:54.519080 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b8772865-c1bf-4ff5-a75a-f588ef6b34c4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:54.519564 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b8772865-c1bf-4ff5-a75a-f588ef6b34c4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:54.520358 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b8772865-c1bf-4ff5-a75a-f588ef6b34c4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:54.520796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b8772865-c1bf-4ff5-a75a-f588ef6b34c4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:54.647129 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b8772865-c1bf-4ff5-a75a-f588ef6b34c4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:54.655113 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b8772865-c1bf-4ff5-a75a-f588ef6b34c4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:54.656642 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b8772865-c1bf-4ff5-a75a-f588ef6b34c4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:54.657781 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b8772865-c1bf-4ff5-a75a-f588ef6b34c4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.150370 Jun 22 18:41:54.658339 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 293/623] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:41:54 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:41:55.675570 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-98acfecc-51a2-46b7-a071-d669729a6ce7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:55.676155 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-98acfecc-51a2-46b7-a071-d669729a6ce7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:55.682086 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-98acfecc-51a2-46b7-a071-d669729a6ce7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:55.682527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-98acfecc-51a2-46b7-a071-d669729a6ce7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:55.683272 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-98acfecc-51a2-46b7-a071-d669729a6ce7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:55.683695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-98acfecc-51a2-46b7-a071-d669729a6ce7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:55.817340 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-98acfecc-51a2-46b7-a071-d669729a6ce7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:55.825754 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-98acfecc-51a2-46b7-a071-d669729a6ce7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:55.827264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-98acfecc-51a2-46b7-a071-d669729a6ce7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:55.828443 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-98acfecc-51a2-46b7-a071-d669729a6ce7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.156856 Jun 22 18:41:55.828990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 331/624] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:41:55 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:41:56.848251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-df555329-9e3c-4944-9cf0-baa5652b7c63 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:56.848925 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-df555329-9e3c-4944-9cf0-baa5652b7c63 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:56.856899 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-df555329-9e3c-4944-9cf0-baa5652b7c63 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:56.858169 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-df555329-9e3c-4944-9cf0-baa5652b7c63 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:56.859414 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-df555329-9e3c-4944-9cf0-baa5652b7c63 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:56.860934 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-df555329-9e3c-4944-9cf0-baa5652b7c63 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:56.999011 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-df555329-9e3c-4944-9cf0-baa5652b7c63 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:57.007570 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-df555329-9e3c-4944-9cf0-baa5652b7c63 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:57.009146 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-df555329-9e3c-4944-9cf0-baa5652b7c63 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:57.010303 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-df555329-9e3c-4944-9cf0-baa5652b7c63 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.167225 Jun 22 18:41:57.010860 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 294/625] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:41:56 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:41:57.572373 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-26cfc63c-1fe7-4ffd-8411-0a25f7e5ac98 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:41:57.578547 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26cfc63c-1fe7-4ffd-8411-0a25f7e5ac98 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:57.578996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26cfc63c-1fe7-4ffd-8411-0a25f7e5ac98 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:57.641611 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-26cfc63c-1fe7-4ffd-8411-0a25f7e5ac98 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Going to try to stop instance {{(pid=129744) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 18:41:57.684204 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-26cfc63c-1fe7-4ffd-8411-0a25f7e5ac98 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "POST /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/action" status: 202 len: 0 microversion: 2.1 time: 0.115328 Jun 22 18:41:57.684704 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 332/626] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:41:57 2022] POST /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:41:57.694221 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-43b89c52-3c70-4cc6-aa2a-93869bf3779b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:57.694836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-43b89c52-3c70-4cc6-aa2a-93869bf3779b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:57.701692 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-43b89c52-3c70-4cc6-aa2a-93869bf3779b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:57.702220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-43b89c52-3c70-4cc6-aa2a-93869bf3779b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:57.702990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-43b89c52-3c70-4cc6-aa2a-93869bf3779b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:57.704110 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-43b89c52-3c70-4cc6-aa2a-93869bf3779b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:57.837348 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-43b89c52-3c70-4cc6-aa2a-93869bf3779b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:57.845412 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-43b89c52-3c70-4cc6-aa2a-93869bf3779b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.155729 Jun 22 18:41:57.845981 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 295/627] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:57 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:58.029201 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-35246304-98b2-4857-8e27-cac099c831db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:58.029916 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-35246304-98b2-4857-8e27-cac099c831db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:58.036204 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-35246304-98b2-4857-8e27-cac099c831db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:58.036652 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-35246304-98b2-4857-8e27-cac099c831db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:58.037418 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-35246304-98b2-4857-8e27-cac099c831db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:58.037851 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-35246304-98b2-4857-8e27-cac099c831db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:58.165360 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-35246304-98b2-4857-8e27-cac099c831db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:58.173834 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-35246304-98b2-4857-8e27-cac099c831db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:58.175354 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-35246304-98b2-4857-8e27-cac099c831db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:58.176515 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-35246304-98b2-4857-8e27-cac099c831db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.151622 Jun 22 18:41:58.177052 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 333/628] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:41:58 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:41:58.862900 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5eccc997-33c9-4079-ab49-de489857a44f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:58.863527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5eccc997-33c9-4079-ab49-de489857a44f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:58.869995 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5eccc997-33c9-4079-ab49-de489857a44f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:58.870434 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5eccc997-33c9-4079-ab49-de489857a44f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:58.871184 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5eccc997-33c9-4079-ab49-de489857a44f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:58.872282 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5eccc997-33c9-4079-ab49-de489857a44f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:58.892113 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:41:59.025052 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5eccc997-33c9-4079-ab49-de489857a44f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:59.034002 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5eccc997-33c9-4079-ab49-de489857a44f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.174930 Jun 22 18:41:59.034567 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 296/629] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:41:58 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:41:59.195368 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-595e039a-e7db-452a-b3f0-2705f04a4af1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:41:59.196001 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-595e039a-e7db-452a-b3f0-2705f04a4af1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:41:59.202424 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-595e039a-e7db-452a-b3f0-2705f04a4af1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:59.202889 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-595e039a-e7db-452a-b3f0-2705f04a4af1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:59.203639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-595e039a-e7db-452a-b3f0-2705f04a4af1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:41:59.204089 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-595e039a-e7db-452a-b3f0-2705f04a4af1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:41:59.337510 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-595e039a-e7db-452a-b3f0-2705f04a4af1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:59.346207 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-595e039a-e7db-452a-b3f0-2705f04a4af1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:59.348012 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-595e039a-e7db-452a-b3f0-2705f04a4af1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:41:59.349142 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-595e039a-e7db-452a-b3f0-2705f04a4af1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.157706 Jun 22 18:41:59.349688 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 334/630] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:41:59 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:00.052534 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-27fdecc2-8a84-4c4d-88ef-48490be7d137 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:00.053092 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-27fdecc2-8a84-4c4d-88ef-48490be7d137 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:00.059524 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-27fdecc2-8a84-4c4d-88ef-48490be7d137 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:00.060008 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-27fdecc2-8a84-4c4d-88ef-48490be7d137 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:00.060773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-27fdecc2-8a84-4c4d-88ef-48490be7d137 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:00.061207 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-27fdecc2-8a84-4c4d-88ef-48490be7d137 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:00.186689 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-27fdecc2-8a84-4c4d-88ef-48490be7d137 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:00.194836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-27fdecc2-8a84-4c4d-88ef-48490be7d137 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.146302 Jun 22 18:42:00.195399 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 297/631] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:00 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:00.367646 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4cd64637-1d60-41e9-972d-e137463c20de tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:00.368253 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4cd64637-1d60-41e9-972d-e137463c20de tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:00.374185 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4cd64637-1d60-41e9-972d-e137463c20de tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:00.374630 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4cd64637-1d60-41e9-972d-e137463c20de tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:00.375388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4cd64637-1d60-41e9-972d-e137463c20de tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:00.375821 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4cd64637-1d60-41e9-972d-e137463c20de tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:00.508053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4cd64637-1d60-41e9-972d-e137463c20de tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:00.516771 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4cd64637-1d60-41e9-972d-e137463c20de tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:00.518286 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4cd64637-1d60-41e9-972d-e137463c20de tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:00.519432 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4cd64637-1d60-41e9-972d-e137463c20de tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.155736 Jun 22 18:42:00.520018 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 335/632] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:00 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:01.211581 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-94fb0af9-4a69-46a8-808c-b70718405f45 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:01.212202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-94fb0af9-4a69-46a8-808c-b70718405f45 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:01.218778 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94fb0af9-4a69-46a8-808c-b70718405f45 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:01.219217 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94fb0af9-4a69-46a8-808c-b70718405f45 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:01.219999 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94fb0af9-4a69-46a8-808c-b70718405f45 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:01.220734 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94fb0af9-4a69-46a8-808c-b70718405f45 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:01.346076 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-94fb0af9-4a69-46a8-808c-b70718405f45 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:01.354323 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-94fb0af9-4a69-46a8-808c-b70718405f45 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.146594 Jun 22 18:42:01.354891 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 298/633] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:01 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:01.537097 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8f8b5a36-de7c-44d5-9fdc-75435e5e8281 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:01.537691 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8f8b5a36-de7c-44d5-9fdc-75435e5e8281 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:01.544581 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8f8b5a36-de7c-44d5-9fdc-75435e5e8281 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:01.545033 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8f8b5a36-de7c-44d5-9fdc-75435e5e8281 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:01.545813 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8f8b5a36-de7c-44d5-9fdc-75435e5e8281 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:01.546251 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8f8b5a36-de7c-44d5-9fdc-75435e5e8281 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:01.675221 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8f8b5a36-de7c-44d5-9fdc-75435e5e8281 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:01.683099 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8f8b5a36-de7c-44d5-9fdc-75435e5e8281 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:01.684668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8f8b5a36-de7c-44d5-9fdc-75435e5e8281 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:01.685810 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8f8b5a36-de7c-44d5-9fdc-75435e5e8281 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.152623 Jun 22 18:42:01.686366 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 336/634] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:01 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:02.372843 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7a354c59-cd59-4097-a1a4-50d9630ae478 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:02.373798 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7a354c59-cd59-4097-a1a4-50d9630ae478 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:02.380398 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7a354c59-cd59-4097-a1a4-50d9630ae478 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:02.381095 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7a354c59-cd59-4097-a1a4-50d9630ae478 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:02.381850 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7a354c59-cd59-4097-a1a4-50d9630ae478 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:02.382275 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7a354c59-cd59-4097-a1a4-50d9630ae478 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:02.516525 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7a354c59-cd59-4097-a1a4-50d9630ae478 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:02.525066 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7a354c59-cd59-4097-a1a4-50d9630ae478 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.156299 Jun 22 18:42:02.525622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 299/635] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:02 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:02.703755 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9e4811d6-c82a-48b7-89f0-7ac8f7ace2c3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:02.704391 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9e4811d6-c82a-48b7-89f0-7ac8f7ace2c3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:02.710546 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9e4811d6-c82a-48b7-89f0-7ac8f7ace2c3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:02.710991 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9e4811d6-c82a-48b7-89f0-7ac8f7ace2c3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:02.711743 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9e4811d6-c82a-48b7-89f0-7ac8f7ace2c3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:02.712230 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9e4811d6-c82a-48b7-89f0-7ac8f7ace2c3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:02.842600 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9e4811d6-c82a-48b7-89f0-7ac8f7ace2c3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:02.850738 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9e4811d6-c82a-48b7-89f0-7ac8f7ace2c3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:02.852260 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9e4811d6-c82a-48b7-89f0-7ac8f7ace2c3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:02.853441 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9e4811d6-c82a-48b7-89f0-7ac8f7ace2c3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.153660 Jun 22 18:42:02.853988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 337/636] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:02 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:03.541482 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6256ec97-76fb-4d10-b5e2-bb9b5ce23f2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:03.542085 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6256ec97-76fb-4d10-b5e2-bb9b5ce23f2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:03.549639 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6256ec97-76fb-4d10-b5e2-bb9b5ce23f2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:03.550125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6256ec97-76fb-4d10-b5e2-bb9b5ce23f2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:03.551033 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6256ec97-76fb-4d10-b5e2-bb9b5ce23f2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:03.551540 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6256ec97-76fb-4d10-b5e2-bb9b5ce23f2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:03.684937 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6256ec97-76fb-4d10-b5e2-bb9b5ce23f2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:03.692945 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6256ec97-76fb-4d10-b5e2-bb9b5ce23f2b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.155277 Jun 22 18:42:03.693530 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 300/637] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:03 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:03.873059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-00cfe653-89cf-4ffc-823f-1c95bda7b24a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:03.873668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-00cfe653-89cf-4ffc-823f-1c95bda7b24a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:03.879720 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-00cfe653-89cf-4ffc-823f-1c95bda7b24a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:03.880249 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-00cfe653-89cf-4ffc-823f-1c95bda7b24a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:03.881220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-00cfe653-89cf-4ffc-823f-1c95bda7b24a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:03.881658 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-00cfe653-89cf-4ffc-823f-1c95bda7b24a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:04.013106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-00cfe653-89cf-4ffc-823f-1c95bda7b24a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:04.021475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-00cfe653-89cf-4ffc-823f-1c95bda7b24a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:04.023002 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-00cfe653-89cf-4ffc-823f-1c95bda7b24a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:04.024200 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-00cfe653-89cf-4ffc-823f-1c95bda7b24a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.155717 Jun 22 18:42:04.024759 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 338/638] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:03 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:04.710382 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6182c1b3-69df-4c8e-89a9-bef53a9c3b4a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:04.710984 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6182c1b3-69df-4c8e-89a9-bef53a9c3b4a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:04.718223 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6182c1b3-69df-4c8e-89a9-bef53a9c3b4a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:04.718661 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6182c1b3-69df-4c8e-89a9-bef53a9c3b4a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:04.719413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6182c1b3-69df-4c8e-89a9-bef53a9c3b4a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:04.719862 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6182c1b3-69df-4c8e-89a9-bef53a9c3b4a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:04.852788 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6182c1b3-69df-4c8e-89a9-bef53a9c3b4a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:04.860992 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6182c1b3-69df-4c8e-89a9-bef53a9c3b4a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.154450 Jun 22 18:42:04.861550 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 301/639] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:04 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:05.043195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a782f249-2d10-4d5f-b408-00fc763136db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:05.044093 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a782f249-2d10-4d5f-b408-00fc763136db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:05.050359 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a782f249-2d10-4d5f-b408-00fc763136db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:05.050828 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a782f249-2d10-4d5f-b408-00fc763136db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:05.051645 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a782f249-2d10-4d5f-b408-00fc763136db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:05.052099 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a782f249-2d10-4d5f-b408-00fc763136db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:05.182100 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a782f249-2d10-4d5f-b408-00fc763136db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:05.190656 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a782f249-2d10-4d5f-b408-00fc763136db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:05.192171 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a782f249-2d10-4d5f-b408-00fc763136db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:05.193291 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a782f249-2d10-4d5f-b408-00fc763136db tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1743 microversion: 2.20 time: 0.154716 Jun 22 18:42:05.193831 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 339/640] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:05 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:42:05.878018 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-0f28ea71-3a6c-4ae4-9815-90dc86a60393 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:05.878649 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0f28ea71-3a6c-4ae4-9815-90dc86a60393 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:05.885272 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0f28ea71-3a6c-4ae4-9815-90dc86a60393 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:05.885713 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0f28ea71-3a6c-4ae4-9815-90dc86a60393 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:05.886462 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0f28ea71-3a6c-4ae4-9815-90dc86a60393 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:05.887796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0f28ea71-3a6c-4ae4-9815-90dc86a60393 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:06.014667 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-0f28ea71-3a6c-4ae4-9815-90dc86a60393 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:06.022537 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-0f28ea71-3a6c-4ae4-9815-90dc86a60393 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.148319 Jun 22 18:42:06.023095 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 302/641] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:05 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:06.212648 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-789cddc6-5acc-4047-a1f0-6c7d6ea4b4dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:06.213305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-789cddc6-5acc-4047-a1f0-6c7d6ea4b4dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:06.220454 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-789cddc6-5acc-4047-a1f0-6c7d6ea4b4dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:06.220907 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-789cddc6-5acc-4047-a1f0-6c7d6ea4b4dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:06.221680 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-789cddc6-5acc-4047-a1f0-6c7d6ea4b4dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:06.222115 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-789cddc6-5acc-4047-a1f0-6c7d6ea4b4dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:06.351992 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-789cddc6-5acc-4047-a1f0-6c7d6ea4b4dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:06.364463 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-789cddc6-5acc-4047-a1f0-6c7d6ea4b4dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:06.365978 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-789cddc6-5acc-4047-a1f0-6c7d6ea4b4dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:06.367118 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-789cddc6-5acc-4047-a1f0-6c7d6ea4b4dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1743 microversion: 2.20 time: 0.158384 Jun 22 18:42:06.367673 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 340/642] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:06 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:07.040304 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ecf1593a-9366-4652-b244-ea2762387229 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:07.040859 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ecf1593a-9366-4652-b244-ea2762387229 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:07.047440 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ecf1593a-9366-4652-b244-ea2762387229 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:07.047915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ecf1593a-9366-4652-b244-ea2762387229 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:07.048684 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ecf1593a-9366-4652-b244-ea2762387229 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:07.049123 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ecf1593a-9366-4652-b244-ea2762387229 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:07.178733 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ecf1593a-9366-4652-b244-ea2762387229 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:07.187017 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ecf1593a-9366-4652-b244-ea2762387229 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.150519 Jun 22 18:42:07.187613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 303/643] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:07 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:42:07.386477 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-14ddd070-3a33-4d2d-b86b-2881066c98f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:07.387590 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-14ddd070-3a33-4d2d-b86b-2881066c98f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:07.393924 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-14ddd070-3a33-4d2d-b86b-2881066c98f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:07.394372 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-14ddd070-3a33-4d2d-b86b-2881066c98f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:07.395135 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-14ddd070-3a33-4d2d-b86b-2881066c98f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:07.395567 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-14ddd070-3a33-4d2d-b86b-2881066c98f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:07.525736 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-14ddd070-3a33-4d2d-b86b-2881066c98f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:07.533822 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-14ddd070-3a33-4d2d-b86b-2881066c98f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:07.535334 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-14ddd070-3a33-4d2d-b86b-2881066c98f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:07.536514 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-14ddd070-3a33-4d2d-b86b-2881066c98f0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1743 microversion: 2.20 time: 0.154355 Jun 22 18:42:07.537068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 341/644] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:07 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:08.204469 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-553b614a-4a07-4293-b28d-709f3693459d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:08.205121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-553b614a-4a07-4293-b28d-709f3693459d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:08.211675 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-553b614a-4a07-4293-b28d-709f3693459d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:08.212155 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-553b614a-4a07-4293-b28d-709f3693459d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:08.212920 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-553b614a-4a07-4293-b28d-709f3693459d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:08.213359 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-553b614a-4a07-4293-b28d-709f3693459d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:08.341891 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-553b614a-4a07-4293-b28d-709f3693459d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:08.349704 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-553b614a-4a07-4293-b28d-709f3693459d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.149666 Jun 22 18:42:08.350261 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 304/645] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:08 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:08.555395 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-457a1dfb-9e31-43fd-b408-e2d4daeea04e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:08.556028 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-457a1dfb-9e31-43fd-b408-e2d4daeea04e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:08.562264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-457a1dfb-9e31-43fd-b408-e2d4daeea04e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:08.562705 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-457a1dfb-9e31-43fd-b408-e2d4daeea04e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:08.563463 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-457a1dfb-9e31-43fd-b408-e2d4daeea04e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:08.564000 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-457a1dfb-9e31-43fd-b408-e2d4daeea04e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:08.688821 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-457a1dfb-9e31-43fd-b408-e2d4daeea04e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:08.696670 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-457a1dfb-9e31-43fd-b408-e2d4daeea04e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:08.698170 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-457a1dfb-9e31-43fd-b408-e2d4daeea04e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:08.700375 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-457a1dfb-9e31-43fd-b408-e2d4daeea04e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1743 microversion: 2.20 time: 0.147975 Jun 22 18:42:08.700935 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 342/646] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:08 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:09.367326 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3febb704-c243-461b-b681-8ece1210b700 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:09.367948 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3febb704-c243-461b-b681-8ece1210b700 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:09.375113 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3febb704-c243-461b-b681-8ece1210b700 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:09.375555 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3febb704-c243-461b-b681-8ece1210b700 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:09.376339 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3febb704-c243-461b-b681-8ece1210b700 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:09.376766 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3febb704-c243-461b-b681-8ece1210b700 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:09.501642 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3febb704-c243-461b-b681-8ece1210b700 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:09.509736 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3febb704-c243-461b-b681-8ece1210b700 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.146245 Jun 22 18:42:09.510290 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 305/647] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:09 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:09.719521 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7ab61c1b-140b-4e1c-8909-960bba3d940a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:09.720101 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7ab61c1b-140b-4e1c-8909-960bba3d940a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:09.726061 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ab61c1b-140b-4e1c-8909-960bba3d940a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:09.726487 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ab61c1b-140b-4e1c-8909-960bba3d940a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:09.727230 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ab61c1b-140b-4e1c-8909-960bba3d940a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:09.727652 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ab61c1b-140b-4e1c-8909-960bba3d940a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:09.746388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:09.858741 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7ab61c1b-140b-4e1c-8909-960bba3d940a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:09.866679 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7ab61c1b-140b-4e1c-8909-960bba3d940a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:09.868209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7ab61c1b-140b-4e1c-8909-960bba3d940a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:09.869353 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7ab61c1b-140b-4e1c-8909-960bba3d940a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1743 microversion: 2.20 time: 0.154411 Jun 22 18:42:09.869908 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 343/648] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:09 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:09.995620 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-f7bcb8a3-654c-41d1-8d50-b8ac95b5e45a req-e662cf6d-9e1c-4178-a2e3-6fdc4c4726f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688c6da6-d454-4dc0-8335-b0a4e16f5824", "name": "network-vif-plugged", "status": "completed", "tag": "24070ee1-9191-4d52-8234-91ae16aa72a0"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:42:10.004183 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-f7bcb8a3-654c-41d1-8d50-b8ac95b5e45a req-e662cf6d-9e1c-4178-a2e3-6fdc4c4726f6 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:10.004602 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-f7bcb8a3-654c-41d1-8d50-b8ac95b5e45a req-e662cf6d-9e1c-4178-a2e3-6fdc4c4726f6 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:10.015812 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-f7bcb8a3-654c-41d1-8d50-b8ac95b5e45a req-e662cf6d-9e1c-4178-a2e3-6fdc4c4726f6 service nova] Creating event network-vif-plugged:24070ee1-9191-4d52-8234-91ae16aa72a0 for instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 on hv-cinder-81268 Jun 22 18:42:10.021004 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-f7bcb8a3-654c-41d1-8d50-b8ac95b5e45a req-e662cf6d-9e1c-4178-a2e3-6fdc4c4726f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029452 Jun 22 18:42:10.021772 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 306/649] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:42:10.526816 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f396e25b-e388-4866-a689-7095c9c08609 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:10.527858 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f396e25b-e388-4866-a689-7095c9c08609 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:10.533972 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f396e25b-e388-4866-a689-7095c9c08609 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:10.534425 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f396e25b-e388-4866-a689-7095c9c08609 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:10.535187 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f396e25b-e388-4866-a689-7095c9c08609 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:10.535623 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f396e25b-e388-4866-a689-7095c9c08609 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:10.669146 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f396e25b-e388-4866-a689-7095c9c08609 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:10.677167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f396e25b-e388-4866-a689-7095c9c08609 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.154252 Jun 22 18:42:10.677729 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 344/650] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:10 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:10.889977 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b4995f45-8052-4f1d-b753-66f0848ebdce tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:10.890599 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b4995f45-8052-4f1d-b753-66f0848ebdce tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:10.896811 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b4995f45-8052-4f1d-b753-66f0848ebdce tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:10.897258 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b4995f45-8052-4f1d-b753-66f0848ebdce tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:10.898013 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b4995f45-8052-4f1d-b753-66f0848ebdce tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:10.898443 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b4995f45-8052-4f1d-b753-66f0848ebdce tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:11.031523 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b4995f45-8052-4f1d-b753-66f0848ebdce tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:11.039350 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b4995f45-8052-4f1d-b753-66f0848ebdce tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:11.040891 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b4995f45-8052-4f1d-b753-66f0848ebdce tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:11.042024 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b4995f45-8052-4f1d-b753-66f0848ebdce tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1743 microversion: 2.20 time: 0.157835 Jun 22 18:42:11.042575 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 307/651] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:10 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:11.695184 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-12e48513-8c3c-489a-a3b3-c3683d791db4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:11.695781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-12e48513-8c3c-489a-a3b3-c3683d791db4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:11.702112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-12e48513-8c3c-489a-a3b3-c3683d791db4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:11.702553 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-12e48513-8c3c-489a-a3b3-c3683d791db4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:11.703309 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-12e48513-8c3c-489a-a3b3-c3683d791db4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:11.703764 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-12e48513-8c3c-489a-a3b3-c3683d791db4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:11.831527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-12e48513-8c3c-489a-a3b3-c3683d791db4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:11.839390 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-12e48513-8c3c-489a-a3b3-c3683d791db4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.148453 Jun 22 18:42:11.840555 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 345/652] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:11 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:12.060569 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f3ea5ed4-e324-4b62-a1f1-b02ab00c6f3f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:12.061170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f3ea5ed4-e324-4b62-a1f1-b02ab00c6f3f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:12.067605 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f3ea5ed4-e324-4b62-a1f1-b02ab00c6f3f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:12.068088 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f3ea5ed4-e324-4b62-a1f1-b02ab00c6f3f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:12.068846 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f3ea5ed4-e324-4b62-a1f1-b02ab00c6f3f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:12.069283 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f3ea5ed4-e324-4b62-a1f1-b02ab00c6f3f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:12.197915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f3ea5ed4-e324-4b62-a1f1-b02ab00c6f3f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:12.206579 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f3ea5ed4-e324-4b62-a1f1-b02ab00c6f3f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:12.208103 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f3ea5ed4-e324-4b62-a1f1-b02ab00c6f3f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:12.209247 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f3ea5ed4-e324-4b62-a1f1-b02ab00c6f3f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1743 microversion: 2.20 time: 0.152610 Jun 22 18:42:12.209797 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 308/653] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:12 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:12.856610 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a40807c7-24c9-4f7d-9dc1-0aad61c4dc78 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:12.857225 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a40807c7-24c9-4f7d-9dc1-0aad61c4dc78 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:12.859096 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=50 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:12.864587 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a40807c7-24c9-4f7d-9dc1-0aad61c4dc78 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:12.865069 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a40807c7-24c9-4f7d-9dc1-0aad61c4dc78 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:12.865835 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a40807c7-24c9-4f7d-9dc1-0aad61c4dc78 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:12.866273 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a40807c7-24c9-4f7d-9dc1-0aad61c4dc78 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:13.228501 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6ef45b8e-489e-4a62-842c-e97f53ee7108 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:13.230434 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6ef45b8e-489e-4a62-842c-e97f53ee7108 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:13.237128 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6ef45b8e-489e-4a62-842c-e97f53ee7108 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:13.237592 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6ef45b8e-489e-4a62-842c-e97f53ee7108 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:13.237828 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a40807c7-24c9-4f7d-9dc1-0aad61c4dc78 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:13.238756 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6ef45b8e-489e-4a62-842c-e97f53ee7108 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:13.239453 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6ef45b8e-489e-4a62-842c-e97f53ee7108 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:13.248492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a40807c7-24c9-4f7d-9dc1-0aad61c4dc78 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1722 microversion: 2.1 time: 0.395706 Jun 22 18:42:13.249607 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 346/654] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:12 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:13.382766 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6ef45b8e-489e-4a62-842c-e97f53ee7108 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:13.392159 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6ef45b8e-489e-4a62-842c-e97f53ee7108 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:13.393397 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6ef45b8e-489e-4a62-842c-e97f53ee7108 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:13.394655 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6ef45b8e-489e-4a62-842c-e97f53ee7108 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1738 microversion: 2.20 time: 0.170354 Jun 22 18:42:13.395114 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 309/655] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:13 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:42:14.268594 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3fe29755-519c-413c-a049-792cb0cef425 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:14.269271 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3fe29755-519c-413c-a049-792cb0cef425 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:14.275915 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3fe29755-519c-413c-a049-792cb0cef425 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:14.276672 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3fe29755-519c-413c-a049-792cb0cef425 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:14.278900 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3fe29755-519c-413c-a049-792cb0cef425 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:14.279587 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3fe29755-519c-413c-a049-792cb0cef425 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:14.413316 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ec52a95d-fcba-4fab-b326-581acd84c677 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:14.413920 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ec52a95d-fcba-4fab-b326-581acd84c677 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:14.421533 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ec52a95d-fcba-4fab-b326-581acd84c677 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:14.422270 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ec52a95d-fcba-4fab-b326-581acd84c677 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:14.423300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ec52a95d-fcba-4fab-b326-581acd84c677 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:14.423990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ec52a95d-fcba-4fab-b326-581acd84c677 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:14.432103 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3fe29755-519c-413c-a049-792cb0cef425 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:14.441523 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3fe29755-519c-413c-a049-792cb0cef425 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1699 microversion: 2.1 time: 0.176987 Jun 22 18:42:14.447698 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 347/656] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:14 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1699 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:14.462476 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2fe10782-f291-4b19-a07e-17dfcb68c668 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:42:14.469192 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2fe10782-f291-4b19-a07e-17dfcb68c668 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:14.469637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2fe10782-f291-4b19-a07e-17dfcb68c668 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:14.496430 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2fe10782-f291-4b19-a07e-17dfcb68c668 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Going to try to start instance {{(pid=129744) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 18:42:14.551884 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2fe10782-f291-4b19-a07e-17dfcb68c668 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "POST /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/action" status: 202 len: 0 microversion: 2.1 time: 0.093106 Jun 22 18:42:14.552762 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 348/657] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:42:14 2022] POST /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:42:14.571386 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ec52a95d-fcba-4fab-b326-581acd84c677 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:14.579068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ce5d786d-b149-428e-8676-dfaa23803594 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:14.580010 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ce5d786d-b149-428e-8676-dfaa23803594 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:14.583639 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ec52a95d-fcba-4fab-b326-581acd84c677 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:14.585437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ec52a95d-fcba-4fab-b326-581acd84c677 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:14.586888 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ec52a95d-fcba-4fab-b326-581acd84c677 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1738 microversion: 2.20 time: 0.177464 Jun 22 18:42:14.587682 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 310/658] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:14 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:42:14.594639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ce5d786d-b149-428e-8676-dfaa23803594 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:14.595207 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ce5d786d-b149-428e-8676-dfaa23803594 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:14.596144 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ce5d786d-b149-428e-8676-dfaa23803594 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:14.596667 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ce5d786d-b149-428e-8676-dfaa23803594 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:14.791047 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ce5d786d-b149-428e-8676-dfaa23803594 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:14.804692 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ce5d786d-b149-428e-8676-dfaa23803594 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1708 microversion: 2.1 time: 0.237673 Jun 22 18:42:14.805480 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 349/659] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:14 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1708 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:15.607828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-017b34db-82f3-4fc9-a93f-d2bad6046c40 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:15.609129 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-017b34db-82f3-4fc9-a93f-d2bad6046c40 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:15.616193 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-017b34db-82f3-4fc9-a93f-d2bad6046c40 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:15.616929 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-017b34db-82f3-4fc9-a93f-d2bad6046c40 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:15.617909 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-017b34db-82f3-4fc9-a93f-d2bad6046c40 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:15.618345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-017b34db-82f3-4fc9-a93f-d2bad6046c40 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:15.775536 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-017b34db-82f3-4fc9-a93f-d2bad6046c40 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:15.784322 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-017b34db-82f3-4fc9-a93f-d2bad6046c40 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:15.786435 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-017b34db-82f3-4fc9-a93f-d2bad6046c40 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:15.787597 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-017b34db-82f3-4fc9-a93f-d2bad6046c40 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1738 microversion: 2.20 time: 0.184745 Jun 22 18:42:15.788543 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 311/660] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:15 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:15.825393 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-691388f9-e222-4949-a1ca-2aae03ff428a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:15.826645 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-691388f9-e222-4949-a1ca-2aae03ff428a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:15.833251 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-691388f9-e222-4949-a1ca-2aae03ff428a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:15.833773 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-691388f9-e222-4949-a1ca-2aae03ff428a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:15.834690 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-691388f9-e222-4949-a1ca-2aae03ff428a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:15.835192 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-691388f9-e222-4949-a1ca-2aae03ff428a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:15.973565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-691388f9-e222-4949-a1ca-2aae03ff428a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:15.982305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-691388f9-e222-4949-a1ca-2aae03ff428a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1708 microversion: 2.1 time: 0.162723 Jun 22 18:42:15.984817 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 350/661] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:15 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:16.807029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-95dd91ae-cea3-46ba-a01a-b77a7462c781 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:16.808526 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-95dd91ae-cea3-46ba-a01a-b77a7462c781 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:16.815361 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-95dd91ae-cea3-46ba-a01a-b77a7462c781 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:16.816082 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-95dd91ae-cea3-46ba-a01a-b77a7462c781 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:16.817230 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-95dd91ae-cea3-46ba-a01a-b77a7462c781 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:16.817683 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-95dd91ae-cea3-46ba-a01a-b77a7462c781 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:16.972878 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-95dd91ae-cea3-46ba-a01a-b77a7462c781 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:16.983123 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-95dd91ae-cea3-46ba-a01a-b77a7462c781 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:16.984568 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-95dd91ae-cea3-46ba-a01a-b77a7462c781 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:16.985791 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-95dd91ae-cea3-46ba-a01a-b77a7462c781 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1738 microversion: 2.20 time: 0.183150 Jun 22 18:42:16.986371 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 312/662] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:16 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:42:17.013404 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5cc45569-1aff-4b1e-8f9b-5de5a4042eec tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:17.014009 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5cc45569-1aff-4b1e-8f9b-5de5a4042eec tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:17.022848 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5cc45569-1aff-4b1e-8f9b-5de5a4042eec tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:17.023378 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5cc45569-1aff-4b1e-8f9b-5de5a4042eec tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:17.024255 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5cc45569-1aff-4b1e-8f9b-5de5a4042eec tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:17.024637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5cc45569-1aff-4b1e-8f9b-5de5a4042eec tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:17.177940 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5cc45569-1aff-4b1e-8f9b-5de5a4042eec tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:17.187608 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5cc45569-1aff-4b1e-8f9b-5de5a4042eec tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1712 microversion: 2.1 time: 0.183863 Jun 22 18:42:17.188751 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 351/663] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:42:17 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1712 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:42:18.008090 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e236c101-8ede-4fea-9385-2a043bceba89 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:18.009610 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e236c101-8ede-4fea-9385-2a043bceba89 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:18.017830 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e236c101-8ede-4fea-9385-2a043bceba89 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:18.018370 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e236c101-8ede-4fea-9385-2a043bceba89 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:18.019203 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e236c101-8ede-4fea-9385-2a043bceba89 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:18.019700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e236c101-8ede-4fea-9385-2a043bceba89 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:18.173336 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e236c101-8ede-4fea-9385-2a043bceba89 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:18.179259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=100 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:18.183100 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e236c101-8ede-4fea-9385-2a043bceba89 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:18.184881 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e236c101-8ede-4fea-9385-2a043bceba89 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:18.186120 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e236c101-8ede-4fea-9385-2a043bceba89 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1738 microversion: 2.20 time: 0.183375 Jun 22 18:42:18.196277 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 313/664] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:18 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:19.205605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-167fbc6d-8231-4256-a0f9-4c8eebf5c181 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:19.206184 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-167fbc6d-8231-4256-a0f9-4c8eebf5c181 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:19.212529 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-167fbc6d-8231-4256-a0f9-4c8eebf5c181 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:19.212969 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-167fbc6d-8231-4256-a0f9-4c8eebf5c181 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:19.213732 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-167fbc6d-8231-4256-a0f9-4c8eebf5c181 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:19.214171 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-167fbc6d-8231-4256-a0f9-4c8eebf5c181 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:19.359858 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-167fbc6d-8231-4256-a0f9-4c8eebf5c181 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:19.368259 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-167fbc6d-8231-4256-a0f9-4c8eebf5c181 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:19.369746 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-167fbc6d-8231-4256-a0f9-4c8eebf5c181 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:19.372016 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-167fbc6d-8231-4256-a0f9-4c8eebf5c181 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1738 microversion: 2.20 time: 0.169772 Jun 22 18:42:19.375937 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 352/665] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:19 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:20.395299 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-be5bc24d-6fb9-4505-b487-2c2193c81f9f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:20.396586 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-be5bc24d-6fb9-4505-b487-2c2193c81f9f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:20.405341 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-be5bc24d-6fb9-4505-b487-2c2193c81f9f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:20.405784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-be5bc24d-6fb9-4505-b487-2c2193c81f9f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:20.406548 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-be5bc24d-6fb9-4505-b487-2c2193c81f9f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:20.406978 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-be5bc24d-6fb9-4505-b487-2c2193c81f9f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:20.551176 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-be5bc24d-6fb9-4505-b487-2c2193c81f9f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:20.561163 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-be5bc24d-6fb9-4505-b487-2c2193c81f9f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:20.562785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-be5bc24d-6fb9-4505-b487-2c2193c81f9f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:20.563956 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-be5bc24d-6fb9-4505-b487-2c2193c81f9f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1738 microversion: 2.20 time: 0.173048 Jun 22 18:42:20.564690 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 314/666] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:20 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:21.582158 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-04f748e0-575e-426f-990a-b3406b1b16d5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:21.582793 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-04f748e0-575e-426f-990a-b3406b1b16d5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:21.590668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-04f748e0-575e-426f-990a-b3406b1b16d5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:21.591106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-04f748e0-575e-426f-990a-b3406b1b16d5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:21.591883 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-04f748e0-575e-426f-990a-b3406b1b16d5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:21.592310 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-04f748e0-575e-426f-990a-b3406b1b16d5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:21.737334 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-04f748e0-575e-426f-990a-b3406b1b16d5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:21.746310 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-04f748e0-575e-426f-990a-b3406b1b16d5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:21.748148 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-04f748e0-575e-426f-990a-b3406b1b16d5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:21.749338 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-04f748e0-575e-426f-990a-b3406b1b16d5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1738 microversion: 2.20 time: 0.171092 Jun 22 18:42:21.750323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 353/667] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:21 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:22.768007 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-aa57db33-89b1-4f6e-aa90-0f144edac8a9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:22.769368 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-aa57db33-89b1-4f6e-aa90-0f144edac8a9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:22.776081 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=46 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:22.778194 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-aa57db33-89b1-4f6e-aa90-0f144edac8a9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:22.778708 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-aa57db33-89b1-4f6e-aa90-0f144edac8a9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:22.779694 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-aa57db33-89b1-4f6e-aa90-0f144edac8a9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:22.780231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-aa57db33-89b1-4f6e-aa90-0f144edac8a9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:22.919566 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-aa57db33-89b1-4f6e-aa90-0f144edac8a9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:22.928953 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-aa57db33-89b1-4f6e-aa90-0f144edac8a9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:22.930766 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-aa57db33-89b1-4f6e-aa90-0f144edac8a9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:22.932448 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-aa57db33-89b1-4f6e-aa90-0f144edac8a9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1738 microversion: 2.20 time: 0.168262 Jun 22 18:42:22.943202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 315/668] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:22 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:23.951079 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-55b8ccbd-10ed-4e13-aaf9-d434af909691 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:23.951673 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-55b8ccbd-10ed-4e13-aaf9-d434af909691 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:23.960844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-55b8ccbd-10ed-4e13-aaf9-d434af909691 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:23.961297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-55b8ccbd-10ed-4e13-aaf9-d434af909691 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:23.962085 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-55b8ccbd-10ed-4e13-aaf9-d434af909691 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:23.962518 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-55b8ccbd-10ed-4e13-aaf9-d434af909691 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:24.109131 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-55b8ccbd-10ed-4e13-aaf9-d434af909691 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:24.117593 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-55b8ccbd-10ed-4e13-aaf9-d434af909691 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:24.119137 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-55b8ccbd-10ed-4e13-aaf9-d434af909691 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:24.120345 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-55b8ccbd-10ed-4e13-aaf9-d434af909691 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1738 microversion: 2.20 time: 0.173720 Jun 22 18:42:24.131233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 354/669] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:23 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:25.138633 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1647b82e-2ad8-4116-aa91-66ab77a676d2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:25.139151 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1647b82e-2ad8-4116-aa91-66ab77a676d2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:25.145711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1647b82e-2ad8-4116-aa91-66ab77a676d2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:25.146156 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1647b82e-2ad8-4116-aa91-66ab77a676d2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:25.146915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1647b82e-2ad8-4116-aa91-66ab77a676d2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:25.147345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1647b82e-2ad8-4116-aa91-66ab77a676d2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:25.285621 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1647b82e-2ad8-4116-aa91-66ab77a676d2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:25.294745 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1647b82e-2ad8-4116-aa91-66ab77a676d2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:25.296285 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1647b82e-2ad8-4116-aa91-66ab77a676d2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:25.297428 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1647b82e-2ad8-4116-aa91-66ab77a676d2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1738 microversion: 2.20 time: 0.162864 Jun 22 18:42:25.297975 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 316/670] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:25 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:26.316535 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-44cabe7e-0a90-4a4c-a2dd-0523958dffb6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:26.317069 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-44cabe7e-0a90-4a4c-a2dd-0523958dffb6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:26.323177 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-44cabe7e-0a90-4a4c-a2dd-0523958dffb6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:26.324771 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-44cabe7e-0a90-4a4c-a2dd-0523958dffb6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:26.325541 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-44cabe7e-0a90-4a4c-a2dd-0523958dffb6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:26.325976 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-44cabe7e-0a90-4a4c-a2dd-0523958dffb6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:26.452728 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-44cabe7e-0a90-4a4c-a2dd-0523958dffb6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:26.461239 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-44cabe7e-0a90-4a4c-a2dd-0523958dffb6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:26.462736 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-44cabe7e-0a90-4a4c-a2dd-0523958dffb6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:26.463968 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-44cabe7e-0a90-4a4c-a2dd-0523958dffb6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1720 microversion: 2.20 time: 0.151394 Jun 22 18:42:26.465164 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 355/671] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:26 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:27.483113 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-cdfa9c57-1b55-41c6-9365-516de686e995 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:27.483708 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-cdfa9c57-1b55-41c6-9365-516de686e995 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:27.490185 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cdfa9c57-1b55-41c6-9365-516de686e995 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:27.490621 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cdfa9c57-1b55-41c6-9365-516de686e995 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:27.491369 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cdfa9c57-1b55-41c6-9365-516de686e995 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:27.491796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cdfa9c57-1b55-41c6-9365-516de686e995 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:27.619626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cdfa9c57-1b55-41c6-9365-516de686e995 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:27.627986 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cdfa9c57-1b55-41c6-9365-516de686e995 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:27.629491 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cdfa9c57-1b55-41c6-9365-516de686e995 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:27.630884 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-cdfa9c57-1b55-41c6-9365-516de686e995 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1720 microversion: 2.20 time: 0.152109 Jun 22 18:42:27.631437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 317/672] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:27 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:28.648975 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2a76e6bf-62e0-4253-8307-d061855e946f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:28.649520 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2a76e6bf-62e0-4253-8307-d061855e946f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:28.655589 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2a76e6bf-62e0-4253-8307-d061855e946f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:28.656088 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2a76e6bf-62e0-4253-8307-d061855e946f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:28.656847 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2a76e6bf-62e0-4253-8307-d061855e946f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:28.657274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2a76e6bf-62e0-4253-8307-d061855e946f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:28.788962 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-2a76e6bf-62e0-4253-8307-d061855e946f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:28.797812 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-2a76e6bf-62e0-4253-8307-d061855e946f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:28.799311 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-2a76e6bf-62e0-4253-8307-d061855e946f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:28.800486 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2a76e6bf-62e0-4253-8307-d061855e946f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1663 microversion: 2.20 time: 0.155493 Jun 22 18:42:28.801034 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 356/673] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:28 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:42:28.824471 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-eba3c470-88dd-4fd7-be30-6bdefd2db4f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7575ff3-eebb-4ece-bb2e-6976ff672f6a"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:42:28.825537 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-eba3c470-88dd-4fd7-be30-6bdefd2db4f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:28.832117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-eba3c470-88dd-4fd7-be30-6bdefd2db4f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:28.832569 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-eba3c470-88dd-4fd7-be30-6bdefd2db4f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:28.833339 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-eba3c470-88dd-4fd7-be30-6bdefd2db4f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:28.833771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-eba3c470-88dd-4fd7-be30-6bdefd2db4f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:29.114320 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-eba3c470-88dd-4fd7-be30-6bdefd2db4f6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "POST /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294276 Jun 22 18:42:29.114904 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 318/674] 10.222.0.18 () {62 vars in 1363 bytes} [Wed Jun 22 18:42:28 2022] POST /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:42:29.239121 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-848110ee-8451-4a45-839a-9b48640dfc47 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:42:29.239673 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-848110ee-8451-4a45-839a-9b48640dfc47 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:29.246382 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-848110ee-8451-4a45-839a-9b48640dfc47 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:29.247267 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-848110ee-8451-4a45-839a-9b48640dfc47 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:29.248066 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-848110ee-8451-4a45-839a-9b48640dfc47 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:29.248522 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-848110ee-8451-4a45-839a-9b48640dfc47 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:29.336914 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-848110ee-8451-4a45-839a-9b48640dfc47 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "POST /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/action" status: 202 len: 0 microversion: 2.20 time: 0.102607 Jun 22 18:42:29.337476 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 357/675] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jun 22 18:42:29 2022] POST /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:42:29.345524 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-882aecfd-e2b1-456f-bca7-11d0da5bdf8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:29.346132 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-882aecfd-e2b1-456f-bca7-11d0da5bdf8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:29.352762 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-882aecfd-e2b1-456f-bca7-11d0da5bdf8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:29.353213 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-882aecfd-e2b1-456f-bca7-11d0da5bdf8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:29.353967 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-882aecfd-e2b1-456f-bca7-11d0da5bdf8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:29.354400 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-882aecfd-e2b1-456f-bca7-11d0da5bdf8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:29.498204 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-882aecfd-e2b1-456f-bca7-11d0da5bdf8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:29.510924 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-882aecfd-e2b1-456f-bca7-11d0da5bdf8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:29.513469 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-882aecfd-e2b1-456f-bca7-11d0da5bdf8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:29.515698 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-882aecfd-e2b1-456f-bca7-11d0da5bdf8b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1749 microversion: 2.20 time: 0.173727 Jun 22 18:42:29.516480 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 319/676] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:29 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1749 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:30.115696 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-63324b45-3b9a-40ec-a6ff-d71778f25676 req-b4d671bf-fd11-415b-8e42-2b38719f7263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688c6da6-d454-4dc0-8335-b0a4e16f5824", "name": "network-vif-unplugged", "status": "completed", "tag": "24070ee1-9191-4d52-8234-91ae16aa72a0"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:42:30.128263 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-63324b45-3b9a-40ec-a6ff-d71778f25676 req-b4d671bf-fd11-415b-8e42-2b38719f7263 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:30.128933 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-63324b45-3b9a-40ec-a6ff-d71778f25676 req-b4d671bf-fd11-415b-8e42-2b38719f7263 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:30.141250 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:30.144891 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.compute.server_external_events [req-63324b45-3b9a-40ec-a6ff-d71778f25676 req-b4d671bf-fd11-415b-8e42-2b38719f7263 service nova] Unable to find a host for instance 688c6da6-d454-4dc0-8335-b0a4e16f5824. Dropping event network-vif-unplugged {{(pid=129744) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 18:42:30.145884 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-63324b45-3b9a-40ec-a6ff-d71778f25676 req-b4d671bf-fd11-415b-8e42-2b38719f7263 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034097 Jun 22 18:42:30.146556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 358/677] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 18:42:30.534636 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ff218c6e-ea9f-4b86-baed-a4a34186f8a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:30.535245 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ff218c6e-ea9f-4b86-baed-a4a34186f8a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:30.541806 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ff218c6e-ea9f-4b86-baed-a4a34186f8a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:30.542255 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ff218c6e-ea9f-4b86-baed-a4a34186f8a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:30.543594 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ff218c6e-ea9f-4b86-baed-a4a34186f8a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:30.544051 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ff218c6e-ea9f-4b86-baed-a4a34186f8a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:30.676083 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ff218c6e-ea9f-4b86-baed-a4a34186f8a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:30.684811 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ff218c6e-ea9f-4b86-baed-a4a34186f8a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:30.686316 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ff218c6e-ea9f-4b86-baed-a4a34186f8a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:30.687467 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ff218c6e-ea9f-4b86-baed-a4a34186f8a5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1751 microversion: 2.20 time: 0.156750 Jun 22 18:42:30.688054 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 320/678] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:30 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:31.706973 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-98759e1b-1279-426b-ac34-a547a19785b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:31.707596 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-98759e1b-1279-426b-ac34-a547a19785b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:31.716238 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-98759e1b-1279-426b-ac34-a547a19785b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:31.716726 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-98759e1b-1279-426b-ac34-a547a19785b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:31.717547 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-98759e1b-1279-426b-ac34-a547a19785b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:31.718010 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-98759e1b-1279-426b-ac34-a547a19785b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:31.860032 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-98759e1b-1279-426b-ac34-a547a19785b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:31.868555 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-98759e1b-1279-426b-ac34-a547a19785b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:31.870057 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-98759e1b-1279-426b-ac34-a547a19785b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:31.871198 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-98759e1b-1279-426b-ac34-a547a19785b8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.168601 Jun 22 18:42:31.871754 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 359/679] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:31 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:32.889787 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b311bc51-cf2d-4ade-99dc-c83639b23715 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:32.890396 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b311bc51-cf2d-4ade-99dc-c83639b23715 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:32.897348 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b311bc51-cf2d-4ade-99dc-c83639b23715 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:32.897800 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b311bc51-cf2d-4ade-99dc-c83639b23715 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:32.898579 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b311bc51-cf2d-4ade-99dc-c83639b23715 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:32.899016 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b311bc51-cf2d-4ade-99dc-c83639b23715 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:33.046106 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b311bc51-cf2d-4ade-99dc-c83639b23715 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:33.054946 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b311bc51-cf2d-4ade-99dc-c83639b23715 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:33.060330 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b311bc51-cf2d-4ade-99dc-c83639b23715 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:33.061521 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b311bc51-cf2d-4ade-99dc-c83639b23715 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.175794 Jun 22 18:42:33.063749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 321/680] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:32 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:34.079775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-08614fdb-f085-4035-98ee-a55a74295261 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:34.080477 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-08614fdb-f085-4035-98ee-a55a74295261 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:34.086682 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-08614fdb-f085-4035-98ee-a55a74295261 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:34.087122 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-08614fdb-f085-4035-98ee-a55a74295261 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:34.087889 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-08614fdb-f085-4035-98ee-a55a74295261 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:34.088316 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-08614fdb-f085-4035-98ee-a55a74295261 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:34.226566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-08614fdb-f085-4035-98ee-a55a74295261 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:34.236915 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-08614fdb-f085-4035-98ee-a55a74295261 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:34.238479 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-08614fdb-f085-4035-98ee-a55a74295261 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:34.239563 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-08614fdb-f085-4035-98ee-a55a74295261 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.163893 Jun 22 18:42:34.240147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 360/681] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:34 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:35.258819 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-49588cdb-c949-4ae6-a2d5-2694faec08ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:35.259460 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-49588cdb-c949-4ae6-a2d5-2694faec08ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:35.266969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-49588cdb-c949-4ae6-a2d5-2694faec08ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:35.267501 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-49588cdb-c949-4ae6-a2d5-2694faec08ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:35.268370 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-49588cdb-c949-4ae6-a2d5-2694faec08ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:35.268879 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-49588cdb-c949-4ae6-a2d5-2694faec08ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:35.418195 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-49588cdb-c949-4ae6-a2d5-2694faec08ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:35.427661 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-49588cdb-c949-4ae6-a2d5-2694faec08ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:35.429215 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-49588cdb-c949-4ae6-a2d5-2694faec08ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:35.430361 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-49588cdb-c949-4ae6-a2d5-2694faec08ac tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.175735 Jun 22 18:42:35.430919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 322/682] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:35 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:36.449160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f315889f-bc2e-4bbf-8f75-7f91eb4f429a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:36.449872 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f315889f-bc2e-4bbf-8f75-7f91eb4f429a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:36.456728 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f315889f-bc2e-4bbf-8f75-7f91eb4f429a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:36.457166 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f315889f-bc2e-4bbf-8f75-7f91eb4f429a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:36.457930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f315889f-bc2e-4bbf-8f75-7f91eb4f429a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:36.458359 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f315889f-bc2e-4bbf-8f75-7f91eb4f429a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:36.593735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f315889f-bc2e-4bbf-8f75-7f91eb4f429a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:36.602507 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f315889f-bc2e-4bbf-8f75-7f91eb4f429a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:36.604048 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f315889f-bc2e-4bbf-8f75-7f91eb4f429a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:36.605259 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f315889f-bc2e-4bbf-8f75-7f91eb4f429a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.159919 Jun 22 18:42:36.605823 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 361/683] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:36 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:37.625371 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2db40d9c-1d97-43da-972a-9c22f49d8d12 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:37.625977 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2db40d9c-1d97-43da-972a-9c22f49d8d12 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:37.633630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2db40d9c-1d97-43da-972a-9c22f49d8d12 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:37.634080 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2db40d9c-1d97-43da-972a-9c22f49d8d12 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:37.634848 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2db40d9c-1d97-43da-972a-9c22f49d8d12 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:37.635277 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2db40d9c-1d97-43da-972a-9c22f49d8d12 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:37.797715 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2db40d9c-1d97-43da-972a-9c22f49d8d12 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:37.807847 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2db40d9c-1d97-43da-972a-9c22f49d8d12 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:37.810187 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2db40d9c-1d97-43da-972a-9c22f49d8d12 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:37.812635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2db40d9c-1d97-43da-972a-9c22f49d8d12 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.192472 Jun 22 18:42:37.813802 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 323/684] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:37 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:38.832194 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a2386336-ac48-478c-958b-550f3e6ad585 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:38.832926 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a2386336-ac48-478c-958b-550f3e6ad585 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:38.839653 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a2386336-ac48-478c-958b-550f3e6ad585 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:38.843232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a2386336-ac48-478c-958b-550f3e6ad585 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:38.844368 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a2386336-ac48-478c-958b-550f3e6ad585 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:38.844992 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a2386336-ac48-478c-958b-550f3e6ad585 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:38.999036 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a2386336-ac48-478c-958b-550f3e6ad585 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:39.008371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a2386336-ac48-478c-958b-550f3e6ad585 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:39.009885 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a2386336-ac48-478c-958b-550f3e6ad585 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:39.011467 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a2386336-ac48-478c-958b-550f3e6ad585 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.183387 Jun 22 18:42:39.012045 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 362/685] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:38 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:40.030529 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a5af912e-7a09-43ca-b43a-292254991382 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:40.031165 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a5af912e-7a09-43ca-b43a-292254991382 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:40.038099 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a5af912e-7a09-43ca-b43a-292254991382 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:40.038629 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a5af912e-7a09-43ca-b43a-292254991382 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:40.039488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a5af912e-7a09-43ca-b43a-292254991382 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:40.039973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a5af912e-7a09-43ca-b43a-292254991382 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:40.177273 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a5af912e-7a09-43ca-b43a-292254991382 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:40.186615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a5af912e-7a09-43ca-b43a-292254991382 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:40.188199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a5af912e-7a09-43ca-b43a-292254991382 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:40.189379 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a5af912e-7a09-43ca-b43a-292254991382 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.162994 Jun 22 18:42:40.189951 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 324/686] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:40 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:41.209204 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9c2232e5-c35b-48af-a929-056e6ae8b220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:41.209782 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9c2232e5-c35b-48af-a929-056e6ae8b220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:41.216572 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9c2232e5-c35b-48af-a929-056e6ae8b220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:41.217012 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9c2232e5-c35b-48af-a929-056e6ae8b220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:41.217767 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9c2232e5-c35b-48af-a929-056e6ae8b220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:41.218191 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9c2232e5-c35b-48af-a929-056e6ae8b220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:41.344593 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9c2232e5-c35b-48af-a929-056e6ae8b220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:41.353220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9c2232e5-c35b-48af-a929-056e6ae8b220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:41.354702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9c2232e5-c35b-48af-a929-056e6ae8b220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:41.355893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9c2232e5-c35b-48af-a929-056e6ae8b220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.150805 Jun 22 18:42:41.357151 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 363/687] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:41 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:42.374451 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-cdff250f-ffe6-4498-a439-022362dbd3e5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:42.375047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-cdff250f-ffe6-4498-a439-022362dbd3e5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:42.381749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cdff250f-ffe6-4498-a439-022362dbd3e5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:42.382337 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cdff250f-ffe6-4498-a439-022362dbd3e5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:42.382936 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cdff250f-ffe6-4498-a439-022362dbd3e5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:42.383362 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cdff250f-ffe6-4498-a439-022362dbd3e5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:42.511157 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cdff250f-ffe6-4498-a439-022362dbd3e5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:42.520065 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cdff250f-ffe6-4498-a439-022362dbd3e5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:42.521836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cdff250f-ffe6-4498-a439-022362dbd3e5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:42.522977 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-cdff250f-ffe6-4498-a439-022362dbd3e5 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.152486 Jun 22 18:42:42.523526 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 325/688] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:42 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:43.540379 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7cecc8ad-5ce7-484b-a465-3df26b4d6d2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:43.540973 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7cecc8ad-5ce7-484b-a465-3df26b4d6d2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:43.542815 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=38 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:43.548146 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7cecc8ad-5ce7-484b-a465-3df26b4d6d2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:43.548589 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7cecc8ad-5ce7-484b-a465-3df26b4d6d2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:43.549339 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7cecc8ad-5ce7-484b-a465-3df26b4d6d2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:43.549764 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7cecc8ad-5ce7-484b-a465-3df26b4d6d2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:43.680003 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7cecc8ad-5ce7-484b-a465-3df26b4d6d2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:43.688994 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7cecc8ad-5ce7-484b-a465-3df26b4d6d2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:43.690489 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7cecc8ad-5ce7-484b-a465-3df26b4d6d2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:43.691627 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7cecc8ad-5ce7-484b-a465-3df26b4d6d2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.155137 Jun 22 18:42:43.692227 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 364/689] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:43 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:44.709960 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2e9d021b-3706-405b-8bdc-3ccde5521ef8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:44.710561 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2e9d021b-3706-405b-8bdc-3ccde5521ef8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:44.717068 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2e9d021b-3706-405b-8bdc-3ccde5521ef8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:44.717515 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2e9d021b-3706-405b-8bdc-3ccde5521ef8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:44.718267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2e9d021b-3706-405b-8bdc-3ccde5521ef8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:44.718700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2e9d021b-3706-405b-8bdc-3ccde5521ef8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:44.862799 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2e9d021b-3706-405b-8bdc-3ccde5521ef8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:44.871045 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2e9d021b-3706-405b-8bdc-3ccde5521ef8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:44.873118 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2e9d021b-3706-405b-8bdc-3ccde5521ef8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:44.874281 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2e9d021b-3706-405b-8bdc-3ccde5521ef8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.168190 Jun 22 18:42:44.874831 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 326/690] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:44 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:45.893653 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-fefb3a9e-ec00-4451-9451-964e816aae8f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:45.894243 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-fefb3a9e-ec00-4451-9451-964e816aae8f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:45.900229 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fefb3a9e-ec00-4451-9451-964e816aae8f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:45.900671 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fefb3a9e-ec00-4451-9451-964e816aae8f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:45.901456 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fefb3a9e-ec00-4451-9451-964e816aae8f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:45.901880 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fefb3a9e-ec00-4451-9451-964e816aae8f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:46.027068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fefb3a9e-ec00-4451-9451-964e816aae8f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:46.036169 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fefb3a9e-ec00-4451-9451-964e816aae8f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:46.037670 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fefb3a9e-ec00-4451-9451-964e816aae8f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:46.038798 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-fefb3a9e-ec00-4451-9451-964e816aae8f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.149333 Jun 22 18:42:46.039346 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 365/691] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:45 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:47.057163 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-777019d0-52b4-47c1-b63e-bd704db9aa05 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:47.057700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-777019d0-52b4-47c1-b63e-bd704db9aa05 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:47.064862 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-777019d0-52b4-47c1-b63e-bd704db9aa05 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:47.065297 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-777019d0-52b4-47c1-b63e-bd704db9aa05 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:47.066053 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-777019d0-52b4-47c1-b63e-bd704db9aa05 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:47.066843 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-777019d0-52b4-47c1-b63e-bd704db9aa05 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:47.195643 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-777019d0-52b4-47c1-b63e-bd704db9aa05 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:47.199149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:47.205900 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-777019d0-52b4-47c1-b63e-bd704db9aa05 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:47.207401 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-777019d0-52b4-47c1-b63e-bd704db9aa05 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:47.208638 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-777019d0-52b4-47c1-b63e-bd704db9aa05 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.155534 Jun 22 18:42:47.209199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 327/692] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:47 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:48.226359 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8b70c01f-0c32-4a51-8df1-32cce9171a83 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:48.226909 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8b70c01f-0c32-4a51-8df1-32cce9171a83 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:48.233287 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8b70c01f-0c32-4a51-8df1-32cce9171a83 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:48.233731 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8b70c01f-0c32-4a51-8df1-32cce9171a83 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:48.234854 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8b70c01f-0c32-4a51-8df1-32cce9171a83 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:48.235302 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8b70c01f-0c32-4a51-8df1-32cce9171a83 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:48.413029 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8b70c01f-0c32-4a51-8df1-32cce9171a83 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:48.421567 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8b70c01f-0c32-4a51-8df1-32cce9171a83 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:48.423047 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8b70c01f-0c32-4a51-8df1-32cce9171a83 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:48.424203 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8b70c01f-0c32-4a51-8df1-32cce9171a83 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.201902 Jun 22 18:42:48.424755 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 366/693] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:48 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:49.443130 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d4c53735-091f-4a2f-a900-d8bc28037a2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:49.443731 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d4c53735-091f-4a2f-a900-d8bc28037a2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:49.450970 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d4c53735-091f-4a2f-a900-d8bc28037a2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:49.451427 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d4c53735-091f-4a2f-a900-d8bc28037a2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:49.452205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d4c53735-091f-4a2f-a900-d8bc28037a2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:49.452635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d4c53735-091f-4a2f-a900-d8bc28037a2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:49.644303 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d4c53735-091f-4a2f-a900-d8bc28037a2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:49.652668 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d4c53735-091f-4a2f-a900-d8bc28037a2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:49.654818 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d4c53735-091f-4a2f-a900-d8bc28037a2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:49.655993 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d4c53735-091f-4a2f-a900-d8bc28037a2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.217500 Jun 22 18:42:49.656540 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 328/694] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:49 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:50.674317 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ef878cf7-cbb2-46ce-9a61-58be177e3f8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:50.674849 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ef878cf7-cbb2-46ce-9a61-58be177e3f8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:50.680894 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ef878cf7-cbb2-46ce-9a61-58be177e3f8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:50.681345 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ef878cf7-cbb2-46ce-9a61-58be177e3f8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:50.682109 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ef878cf7-cbb2-46ce-9a61-58be177e3f8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:50.682553 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ef878cf7-cbb2-46ce-9a61-58be177e3f8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:50.812972 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ef878cf7-cbb2-46ce-9a61-58be177e3f8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:50.821321 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ef878cf7-cbb2-46ce-9a61-58be177e3f8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:50.822819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ef878cf7-cbb2-46ce-9a61-58be177e3f8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:50.823987 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ef878cf7-cbb2-46ce-9a61-58be177e3f8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.153666 Jun 22 18:42:50.824539 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 367/695] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:50 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:51.843724 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f42aba3e-0d1f-4e64-8e59-732268ffec6f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:51.844376 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f42aba3e-0d1f-4e64-8e59-732268ffec6f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:51.851007 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f42aba3e-0d1f-4e64-8e59-732268ffec6f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:51.851455 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f42aba3e-0d1f-4e64-8e59-732268ffec6f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:51.852236 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f42aba3e-0d1f-4e64-8e59-732268ffec6f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:51.852673 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f42aba3e-0d1f-4e64-8e59-732268ffec6f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:51.980676 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f42aba3e-0d1f-4e64-8e59-732268ffec6f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:51.989058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f42aba3e-0d1f-4e64-8e59-732268ffec6f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:51.990557 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f42aba3e-0d1f-4e64-8e59-732268ffec6f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:51.991701 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f42aba3e-0d1f-4e64-8e59-732268ffec6f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.153039 Jun 22 18:42:51.992278 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 329/696] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:51 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:53.010493 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-acf21cd9-709d-4e9a-b165-6643e060b79b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:53.011900 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-acf21cd9-709d-4e9a-b165-6643e060b79b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:53.018583 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-acf21cd9-709d-4e9a-b165-6643e060b79b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:53.019259 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-acf21cd9-709d-4e9a-b165-6643e060b79b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:53.020069 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-acf21cd9-709d-4e9a-b165-6643e060b79b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:53.020497 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-acf21cd9-709d-4e9a-b165-6643e060b79b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:53.151721 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-acf21cd9-709d-4e9a-b165-6643e060b79b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:53.170861 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-acf21cd9-709d-4e9a-b165-6643e060b79b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:53.172645 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-acf21cd9-709d-4e9a-b165-6643e060b79b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:53.177144 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-acf21cd9-709d-4e9a-b165-6643e060b79b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.170588 Jun 22 18:42:53.177705 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 368/697] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:53 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:54.194660 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-cf27b9f4-ca94-42df-b5c9-706ed20fdfc1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:54.195293 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-cf27b9f4-ca94-42df-b5c9-706ed20fdfc1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:54.197766 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=30 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:42:54.203959 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cf27b9f4-ca94-42df-b5c9-706ed20fdfc1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:54.204404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cf27b9f4-ca94-42df-b5c9-706ed20fdfc1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:54.205215 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cf27b9f4-ca94-42df-b5c9-706ed20fdfc1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:54.205631 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cf27b9f4-ca94-42df-b5c9-706ed20fdfc1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:54.343026 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cf27b9f4-ca94-42df-b5c9-706ed20fdfc1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:54.352070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cf27b9f4-ca94-42df-b5c9-706ed20fdfc1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:54.354392 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cf27b9f4-ca94-42df-b5c9-706ed20fdfc1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:54.355794 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-cf27b9f4-ca94-42df-b5c9-706ed20fdfc1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.165211 Jun 22 18:42:54.356402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 330/698] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:54 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:55.375177 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3e919f2d-eb9a-421e-be35-372858d66bc6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:55.375797 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3e919f2d-eb9a-421e-be35-372858d66bc6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:55.382122 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3e919f2d-eb9a-421e-be35-372858d66bc6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:55.382562 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3e919f2d-eb9a-421e-be35-372858d66bc6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:55.383311 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3e919f2d-eb9a-421e-be35-372858d66bc6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:55.383737 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3e919f2d-eb9a-421e-be35-372858d66bc6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:55.512825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3e919f2d-eb9a-421e-be35-372858d66bc6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:55.521666 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3e919f2d-eb9a-421e-be35-372858d66bc6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:55.523143 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3e919f2d-eb9a-421e-be35-372858d66bc6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:55.524304 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3e919f2d-eb9a-421e-be35-372858d66bc6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.153715 Jun 22 18:42:55.524852 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 369/699] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:55 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:56.316474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-27bafec1-8c30-4026-911e-97df50feee16 req-817861bb-d82b-4ad4-b070-50c33e85c4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688c6da6-d454-4dc0-8335-b0a4e16f5824", "name": "network-vif-plugged", "status": "completed", "tag": "24070ee1-9191-4d52-8234-91ae16aa72a0"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:42:56.326866 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-27bafec1-8c30-4026-911e-97df50feee16 req-817861bb-d82b-4ad4-b070-50c33e85c4e7 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:56.327607 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-27bafec1-8c30-4026-911e-97df50feee16 req-817861bb-d82b-4ad4-b070-50c33e85c4e7 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:56.338653 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-27bafec1-8c30-4026-911e-97df50feee16 req-817861bb-d82b-4ad4-b070-50c33e85c4e7 service nova] Creating event network-vif-plugged:24070ee1-9191-4d52-8234-91ae16aa72a0 for instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 on hv-cinder-81268 Jun 22 18:42:56.344445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-27bafec1-8c30-4026-911e-97df50feee16 req-817861bb-d82b-4ad4-b070-50c33e85c4e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031605 Jun 22 18:42:56.345065 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 331/700] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:42:56.543635 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-374501ed-ea42-43ec-b7ae-6337b4e7d2e6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:56.544262 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-374501ed-ea42-43ec-b7ae-6337b4e7d2e6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:56.550336 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-374501ed-ea42-43ec-b7ae-6337b4e7d2e6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:56.550780 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-374501ed-ea42-43ec-b7ae-6337b4e7d2e6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:56.551562 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-374501ed-ea42-43ec-b7ae-6337b4e7d2e6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:56.552163 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-374501ed-ea42-43ec-b7ae-6337b4e7d2e6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:56.678756 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-374501ed-ea42-43ec-b7ae-6337b4e7d2e6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:56.687632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-374501ed-ea42-43ec-b7ae-6337b4e7d2e6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:56.689166 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-374501ed-ea42-43ec-b7ae-6337b4e7d2e6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:56.690305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-374501ed-ea42-43ec-b7ae-6337b4e7d2e6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.150563 Jun 22 18:42:56.690867 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 370/701] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:56 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:57.709806 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e62deaa2-cee4-42de-81e0-dfed82843950 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:57.710494 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e62deaa2-cee4-42de-81e0-dfed82843950 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:57.717230 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e62deaa2-cee4-42de-81e0-dfed82843950 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:57.717671 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e62deaa2-cee4-42de-81e0-dfed82843950 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:57.718421 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e62deaa2-cee4-42de-81e0-dfed82843950 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:57.718848 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e62deaa2-cee4-42de-81e0-dfed82843950 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:57.848874 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e62deaa2-cee4-42de-81e0-dfed82843950 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:57.857141 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e62deaa2-cee4-42de-81e0-dfed82843950 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:57.858651 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e62deaa2-cee4-42de-81e0-dfed82843950 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:57.859784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e62deaa2-cee4-42de-81e0-dfed82843950 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.154694 Jun 22 18:42:57.860357 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 332/702] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:57 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:42:58.879082 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-72b9827d-6d5b-4dbe-84a9-5b282e1fa488 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:42:58.879622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-72b9827d-6d5b-4dbe-84a9-5b282e1fa488 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:42:58.886553 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-72b9827d-6d5b-4dbe-84a9-5b282e1fa488 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:58.887078 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-72b9827d-6d5b-4dbe-84a9-5b282e1fa488 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:58.888100 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-72b9827d-6d5b-4dbe-84a9-5b282e1fa488 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:42:58.888634 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-72b9827d-6d5b-4dbe-84a9-5b282e1fa488 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:42:59.028239 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-72b9827d-6d5b-4dbe-84a9-5b282e1fa488 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:59.037501 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-72b9827d-6d5b-4dbe-84a9-5b282e1fa488 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:59.038988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-72b9827d-6d5b-4dbe-84a9-5b282e1fa488 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:42:59.040138 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-72b9827d-6d5b-4dbe-84a9-5b282e1fa488 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1807 microversion: 2.20 time: 0.165210 Jun 22 18:42:59.040684 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 371/703] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:42:58 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:43:00.058770 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ca5ed644-7f88-4262-ae03-9a5aa30fa522 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:00.059322 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ca5ed644-7f88-4262-ae03-9a5aa30fa522 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:00.066054 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca5ed644-7f88-4262-ae03-9a5aa30fa522 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:00.066502 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca5ed644-7f88-4262-ae03-9a5aa30fa522 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:00.067264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca5ed644-7f88-4262-ae03-9a5aa30fa522 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:00.067696 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca5ed644-7f88-4262-ae03-9a5aa30fa522 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:00.206587 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ca5ed644-7f88-4262-ae03-9a5aa30fa522 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:00.214947 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ca5ed644-7f88-4262-ae03-9a5aa30fa522 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:00.217107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ca5ed644-7f88-4262-ae03-9a5aa30fa522 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:00.218241 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ca5ed644-7f88-4262-ae03-9a5aa30fa522 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1794 microversion: 2.20 time: 0.163479 Jun 22 18:43:00.218794 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 333/704] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:43:00 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1794 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:43:22.534223 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=15 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:22.534967 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=78 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:22.637878 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-75502bf6-22f5-4355-b48f-8dc31c5662b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7169e0f-3ded-46ef-aba3-c8b6f61dd09e"}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:43:22.638992 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-75502bf6-22f5-4355-b48f-8dc31c5662b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:22.645069 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-75502bf6-22f5-4355-b48f-8dc31c5662b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:22.645517 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-75502bf6-22f5-4355-b48f-8dc31c5662b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:22.646281 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-75502bf6-22f5-4355-b48f-8dc31c5662b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:22.646711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-75502bf6-22f5-4355-b48f-8dc31c5662b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:22.896678 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-75502bf6-22f5-4355-b48f-8dc31c5662b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "POST /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367114 Jun 22 18:43:22.897277 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 372/705] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:43:22 2022] POST /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:43:23.931510 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-0cacbe53-40b6-48ec-a8ca-74c044d3925f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:23.932103 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0cacbe53-40b6-48ec-a8ca-74c044d3925f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:23.935568 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=7 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:23.936358 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=32 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:23.942144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0cacbe53-40b6-48ec-a8ca-74c044d3925f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:23.942586 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0cacbe53-40b6-48ec-a8ca-74c044d3925f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:23.943345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0cacbe53-40b6-48ec-a8ca-74c044d3925f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:23.943779 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0cacbe53-40b6-48ec-a8ca-74c044d3925f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:23.968747 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-0cacbe53-40b6-48ec-a8ca-74c044d3925f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc/ips" status: 200 len: 150 microversion: 2.1 time: 0.041096 Jun 22 18:43:23.969403 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 334/706] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 18:43:23 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:43:25.322258 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f2f0e121-3a5e-4a91-a94f-0ae66de479df tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab70ab56-84c3-4d90-9bd3-1b3304a3a7bd"}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:43:25.323457 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f2f0e121-3a5e-4a91-a94f-0ae66de479df tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:25.331009 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f2f0e121-3a5e-4a91-a94f-0ae66de479df tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:25.331460 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f2f0e121-3a5e-4a91-a94f-0ae66de479df tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:25.332263 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f2f0e121-3a5e-4a91-a94f-0ae66de479df tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:25.332698 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f2f0e121-3a5e-4a91-a94f-0ae66de479df tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:25.569345 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f2f0e121-3a5e-4a91-a94f-0ae66de479df tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "POST /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251624 Jun 22 18:43:25.569941 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 373/707] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:43:25 2022] POST /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:43:30.387065 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a9bac3af-a6a4-4cf8-b876-7152d880fceb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:43:30.387715 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a9bac3af-a6a4-4cf8-b876-7152d880fceb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:30.393677 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a9bac3af-a6a4-4cf8-b876-7152d880fceb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:30.394115 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a9bac3af-a6a4-4cf8-b876-7152d880fceb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:30.394863 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a9bac3af-a6a4-4cf8-b876-7152d880fceb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:30.395293 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a9bac3af-a6a4-4cf8-b876-7152d880fceb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:30.418205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.objects.instance [None req-a9bac3af-a6a4-4cf8-b876-7152d880fceb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lazy-loading 'flavor' on Instance uuid 398c2e47-c400-4fc9-9886-3bae472ef7ef {{(pid=129743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:43:30.582823 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a9bac3af-a6a4-4cf8-b876-7152d880fceb tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "POST /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/action" status: 200 len: 32 microversion: 2.1 time: 0.200334 Jun 22 18:43:30.583439 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 335/708] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:43:30 2022] POST /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 18:43:30.594385 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-96bb0708-dd13-47f1-bda6-f3126512dc93 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:30.595171 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-96bb0708-dd13-47f1-bda6-f3126512dc93 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:30.602400 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-96bb0708-dd13-47f1-bda6-f3126512dc93 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:30.602971 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-96bb0708-dd13-47f1-bda6-f3126512dc93 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:30.604341 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-96bb0708-dd13-47f1-bda6-f3126512dc93 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:30.604794 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-96bb0708-dd13-47f1-bda6-f3126512dc93 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:30.738075 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-96bb0708-dd13-47f1-bda6-f3126512dc93 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:30.746766 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-96bb0708-dd13-47f1-bda6-f3126512dc93 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.157447 Jun 22 18:43:30.747387 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 374/709] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:30 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:31.765247 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-9d15601d-1d43-401f-b100-3c660649377f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:31.765934 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-9d15601d-1d43-401f-b100-3c660649377f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:31.772271 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9d15601d-1d43-401f-b100-3c660649377f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:31.772718 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9d15601d-1d43-401f-b100-3c660649377f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:31.773473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9d15601d-1d43-401f-b100-3c660649377f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:31.773899 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9d15601d-1d43-401f-b100-3c660649377f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:31.903450 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-9d15601d-1d43-401f-b100-3c660649377f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:31.914038 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-9d15601d-1d43-401f-b100-3c660649377f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.154125 Jun 22 18:43:31.914607 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 336/710] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:31 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:32.931195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7b94da24-3f51-492b-a387-ef6e938fb706 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:32.931733 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7b94da24-3f51-492b-a387-ef6e938fb706 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:32.938480 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7b94da24-3f51-492b-a387-ef6e938fb706 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:32.938923 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7b94da24-3f51-492b-a387-ef6e938fb706 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:32.939685 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7b94da24-3f51-492b-a387-ef6e938fb706 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:32.940146 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7b94da24-3f51-492b-a387-ef6e938fb706 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:33.071783 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7b94da24-3f51-492b-a387-ef6e938fb706 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:33.080276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7b94da24-3f51-492b-a387-ef6e938fb706 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.152996 Jun 22 18:43:33.080840 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 375/711] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:32 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:34.097359 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5fb49224-117c-4ab5-90af-2d8338876853 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:34.097967 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5fb49224-117c-4ab5-90af-2d8338876853 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:34.104533 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5fb49224-117c-4ab5-90af-2d8338876853 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:34.105178 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5fb49224-117c-4ab5-90af-2d8338876853 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:34.106100 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5fb49224-117c-4ab5-90af-2d8338876853 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:34.106538 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5fb49224-117c-4ab5-90af-2d8338876853 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:34.238665 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5fb49224-117c-4ab5-90af-2d8338876853 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:34.248061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5fb49224-117c-4ab5-90af-2d8338876853 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.154207 Jun 22 18:43:34.248594 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 337/712] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:34 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:35.265750 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5a7fd18a-619e-433c-8eaf-89611ef0fccd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:35.266353 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5a7fd18a-619e-433c-8eaf-89611ef0fccd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:35.272799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5a7fd18a-619e-433c-8eaf-89611ef0fccd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:35.273243 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5a7fd18a-619e-433c-8eaf-89611ef0fccd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:35.274001 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5a7fd18a-619e-433c-8eaf-89611ef0fccd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:35.274429 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5a7fd18a-619e-433c-8eaf-89611ef0fccd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:35.403952 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5a7fd18a-619e-433c-8eaf-89611ef0fccd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:35.411925 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5a7fd18a-619e-433c-8eaf-89611ef0fccd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.150424 Jun 22 18:43:35.412475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 376/713] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:35 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:36.429584 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f6a4bc0d-6ef1-4c0b-a68a-614a77c11373 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:36.430114 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f6a4bc0d-6ef1-4c0b-a68a-614a77c11373 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:36.437373 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f6a4bc0d-6ef1-4c0b-a68a-614a77c11373 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:36.437828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f6a4bc0d-6ef1-4c0b-a68a-614a77c11373 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:36.438960 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f6a4bc0d-6ef1-4c0b-a68a-614a77c11373 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:36.439046 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f6a4bc0d-6ef1-4c0b-a68a-614a77c11373 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:36.574473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f6a4bc0d-6ef1-4c0b-a68a-614a77c11373 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:36.582635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f6a4bc0d-6ef1-4c0b-a68a-614a77c11373 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.157369 Jun 22 18:43:36.583195 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 338/714] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:36 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:36.872258 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-bfb3b32f-1fa1-4cc8-a390-d6b63e22545b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:36.872731 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-bfb3b32f-1fa1-4cc8-a390-d6b63e22545b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:36.878699 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bfb3b32f-1fa1-4cc8-a390-d6b63e22545b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:36.879136 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bfb3b32f-1fa1-4cc8-a390-d6b63e22545b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:36.880177 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bfb3b32f-1fa1-4cc8-a390-d6b63e22545b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:36.880606 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bfb3b32f-1fa1-4cc8-a390-d6b63e22545b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:37.004921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-bfb3b32f-1fa1-4cc8-a390-d6b63e22545b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lazy-loading 'services' on Instance uuid 2a9799ba-7e8d-4145-b942-752d45813cfc {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:43:37.116357 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-bfb3b32f-1fa1-4cc8-a390-d6b63e22545b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/os-volume_attachments/d1abbdb0-343c-464c-8529-d11a87afc62a" status: 202 len: 0 microversion: 2.1 time: 0.345990 Jun 22 18:43:37.117012 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 377/715] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 18:43:36 2022] DELETE /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/os-volume_attachments/d1abbdb0-343c-464c-8529-d11a87afc62a => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:43:37.278295 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e4a3743a-6671-43c7-b44a-060d56a2bd78 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Action: 'create', calling method: .version_select at 0x7fd7555b18b0>, body: {"keypair": {"name": "tempest-keypair-585318712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRvuPjlIInw3R8aWwJuEdiJzzYUXY771ORVlXejrsapgG+6Hk1xc0RYdjKSjkH1dYTXuKDnmaG/rhlom1aa3kjzaJDK+NFWBu0K56t/dqsZ09URfdvtQuAZ1mj1/CgYYQ=="}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:43:37.291930 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-e4a3743a-6671-43c7-b44a-060d56a2bd78 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:43:37.295678 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-e4a3743a-6671-43c7-b44a-060d56a2bd78 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for user bfa74308096d40daac0a67c9ebec8d8d and project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:43:37.319863 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e4a3743a-6671-43c7-b44a-060d56a2bd78 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045343 Jun 22 18:43:37.320358 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 339/716] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 18:43:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:43:37.600855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ac443691-72c1-4338-9fac-58a4ee2c8e55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:37.601666 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ac443691-72c1-4338-9fac-58a4ee2c8e55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:37.609465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ac443691-72c1-4338-9fac-58a4ee2c8e55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:37.609954 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ac443691-72c1-4338-9fac-58a4ee2c8e55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:37.610852 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ac443691-72c1-4338-9fac-58a4ee2c8e55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:37.611357 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ac443691-72c1-4338-9fac-58a4ee2c8e55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:37.794957 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ac443691-72c1-4338-9fac-58a4ee2c8e55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:37.803575 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ac443691-72c1-4338-9fac-58a4ee2c8e55 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.206796 Jun 22 18:43:37.804399 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 378/717] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:37 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:38.230924 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d116487b-ca4c-4c15-b333-e84bd7551bf2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:43:38.236800 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d116487b-ca4c-4c15-b333-e84bd7551bf2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:38.237246 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d116487b-ca4c-4c15-b333-e84bd7551bf2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:38.300882 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d116487b-ca4c-4c15-b333-e84bd7551bf2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Going to try to stop instance {{(pid=129743) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 18:43:38.345803 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d116487b-ca4c-4c15-b333-e84bd7551bf2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "POST /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/action" status: 202 len: 0 microversion: 2.1 time: 0.119903 Jun 22 18:43:38.346405 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 340/718] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:43:38 2022] POST /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:43:38.354439 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c401731b-7eee-451a-9464-f0b98777015f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:38.355751 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c401731b-7eee-451a-9464-f0b98777015f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:38.362905 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c401731b-7eee-451a-9464-f0b98777015f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:38.363280 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c401731b-7eee-451a-9464-f0b98777015f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:38.364077 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c401731b-7eee-451a-9464-f0b98777015f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:38.364533 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c401731b-7eee-451a-9464-f0b98777015f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:38.495404 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c401731b-7eee-451a-9464-f0b98777015f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:38.502966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c401731b-7eee-451a-9464-f0b98777015f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1676 microversion: 2.1 time: 0.152385 Jun 22 18:43:38.503529 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 379/719] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:38 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:38.693557 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1909254531", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22c9b457-d574-4ec6-85ed-412ef1688a3f"}], "security_groups": [{"name": "tempest-securitygroup--1669120709"}], "key_name": "tempest-keypair-585318712", "user_data": "}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:43:38.798484 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.network.neutron [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] validate_networks() for [('22c9b457-d574-4ec6-85ed-412ef1688a3f', None, None, None, None, None)] {{(pid=129743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:43:38.822305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9535c948-e2f0-4aaa-a39a-900ab31f5716 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:38.822894 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9535c948-e2f0-4aaa-a39a-900ab31f5716 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:38.830326 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9535c948-e2f0-4aaa-a39a-900ab31f5716 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:38.830777 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9535c948-e2f0-4aaa-a39a-900ab31f5716 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:38.831581 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9535c948-e2f0-4aaa-a39a-900ab31f5716 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:38.832120 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9535c948-e2f0-4aaa-a39a-900ab31f5716 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:38.967778 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9535c948-e2f0-4aaa-a39a-900ab31f5716 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:38.975930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9535c948-e2f0-4aaa-a39a-900ab31f5716 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.157350 Jun 22 18:43:38.976708 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 380/720] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:38 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:43:39.212837 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Flavor limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:43:39.213259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Image limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:43:39.213729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Flavor pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:43:39.214204 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Image pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:43:39.214614 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:43:39.223322 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:39.223767 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:39.224599 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:39.225033 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:39.242486 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:43:39.247069 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for user bfa74308096d40daac0a67c9ebec8d8d and project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:43:39.258288 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Going to run 1 instances... {{(pid=129743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:43:39.260650 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:43:39.306019 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-dcc1ad2f-62d5-4e56-afb6-68d2d7b51b32 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.617027 Jun 22 18:43:39.306660 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 341/721] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:43:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:43:39.316415 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0441f778-f9ea-40e7-a19c-bbb00b09b3d2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:39.317021 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0441f778-f9ea-40e7-a19c-bbb00b09b3d2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:39.369456 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0441f778-f9ea-40e7-a19c-bbb00b09b3d2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:39.376346 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0441f778-f9ea-40e7-a19c-bbb00b09b3d2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1241 microversion: 2.1 time: 0.063514 Jun 22 18:43:39.376910 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 381/722] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:39 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:39.520096 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7b7c0c0f-54e2-409d-9fe1-1a71c1f384b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:39.520810 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7b7c0c0f-54e2-409d-9fe1-1a71c1f384b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:39.527906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7b7c0c0f-54e2-409d-9fe1-1a71c1f384b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:39.528415 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7b7c0c0f-54e2-409d-9fe1-1a71c1f384b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:39.529091 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7b7c0c0f-54e2-409d-9fe1-1a71c1f384b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:39.529521 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7b7c0c0f-54e2-409d-9fe1-1a71c1f384b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:39.662310 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7b7c0c0f-54e2-409d-9fe1-1a71c1f384b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:39.671354 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7b7c0c0f-54e2-409d-9fe1-1a71c1f384b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1676 microversion: 2.1 time: 0.155007 Jun 22 18:43:39.672047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 342/723] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:39 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:39.993643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f77c1975-b6f1-4daf-9b26-9401c6009b72 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:39.994188 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f77c1975-b6f1-4daf-9b26-9401c6009b72 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:40.002587 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f77c1975-b6f1-4daf-9b26-9401c6009b72 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:40.003065 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f77c1975-b6f1-4daf-9b26-9401c6009b72 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:40.003854 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f77c1975-b6f1-4daf-9b26-9401c6009b72 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:40.004287 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f77c1975-b6f1-4daf-9b26-9401c6009b72 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:40.138260 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f77c1975-b6f1-4daf-9b26-9401c6009b72 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:40.146196 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f77c1975-b6f1-4daf-9b26-9401c6009b72 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.156852 Jun 22 18:43:40.146756 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 382/724] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:39 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:40.393401 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-28fab20b-5d5c-4638-aef8-5d2ac07156cd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:40.394022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-28fab20b-5d5c-4638-aef8-5d2ac07156cd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:40.401137 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-28fab20b-5d5c-4638-aef8-5d2ac07156cd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:40.401593 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-28fab20b-5d5c-4638-aef8-5d2ac07156cd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:40.402992 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-28fab20b-5d5c-4638-aef8-5d2ac07156cd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:40.403404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-28fab20b-5d5c-4638-aef8-5d2ac07156cd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:40.503498 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-28fab20b-5d5c-4638-aef8-5d2ac07156cd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:40.512742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-28fab20b-5d5c-4638-aef8-5d2ac07156cd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1301 microversion: 2.1 time: 0.123160 Jun 22 18:43:40.513584 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 343/725] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:40 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1301 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:40.689508 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-68454d95-e61a-4620-bc8b-0ed8a78746fc tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:40.690104 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-68454d95-e61a-4620-bc8b-0ed8a78746fc tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:40.696044 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-68454d95-e61a-4620-bc8b-0ed8a78746fc tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:40.696490 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-68454d95-e61a-4620-bc8b-0ed8a78746fc tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:40.697243 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-68454d95-e61a-4620-bc8b-0ed8a78746fc tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:40.697672 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-68454d95-e61a-4620-bc8b-0ed8a78746fc tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:40.838792 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-68454d95-e61a-4620-bc8b-0ed8a78746fc tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:40.846537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-68454d95-e61a-4620-bc8b-0ed8a78746fc tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1676 microversion: 2.1 time: 0.160810 Jun 22 18:43:40.847098 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 383/726] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:40 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:41.164102 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a1480171-cd1e-4046-b5c1-6b9fa849973b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:41.165210 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a1480171-cd1e-4046-b5c1-6b9fa849973b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:41.172243 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a1480171-cd1e-4046-b5c1-6b9fa849973b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:41.172775 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a1480171-cd1e-4046-b5c1-6b9fa849973b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:41.173830 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a1480171-cd1e-4046-b5c1-6b9fa849973b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:41.174356 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a1480171-cd1e-4046-b5c1-6b9fa849973b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:41.377024 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a1480171-cd1e-4046-b5c1-6b9fa849973b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:41.385796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a1480171-cd1e-4046-b5c1-6b9fa849973b tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.225542 Jun 22 18:43:41.395919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 344/727] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:41 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:41.530879 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a1d8a0a5-eb75-452d-9b30-a2c635434857 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:41.531482 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a1d8a0a5-eb75-452d-9b30-a2c635434857 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:41.537915 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a1d8a0a5-eb75-452d-9b30-a2c635434857 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:41.538360 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a1d8a0a5-eb75-452d-9b30-a2c635434857 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:41.539110 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a1d8a0a5-eb75-452d-9b30-a2c635434857 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:41.539541 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a1d8a0a5-eb75-452d-9b30-a2c635434857 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:41.675073 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a1d8a0a5-eb75-452d-9b30-a2c635434857 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:41.682651 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a1d8a0a5-eb75-452d-9b30-a2c635434857 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1367 microversion: 2.1 time: 0.156420 Jun 22 18:43:41.683704 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 384/728] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:41 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:41.865849 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-72fe969f-f7a8-4d8b-9375-6d27acb40f1e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:41.866710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-72fe969f-f7a8-4d8b-9375-6d27acb40f1e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:41.874801 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-72fe969f-f7a8-4d8b-9375-6d27acb40f1e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:41.875226 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-72fe969f-f7a8-4d8b-9375-6d27acb40f1e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:41.876032 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-72fe969f-f7a8-4d8b-9375-6d27acb40f1e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:41.876596 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-72fe969f-f7a8-4d8b-9375-6d27acb40f1e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:41.941760 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-f7b24bb0-d838-409a-a5a5-5fab46ce1184 req-7138f7a9-977d-4b61-93ee-6ebc20538b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2", "tag": "c5ca791e-ba61-4c19-9ffe-a553a1defb00"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:43:41.951557 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-f7b24bb0-d838-409a-a5a5-5fab46ce1184 req-7138f7a9-977d-4b61-93ee-6ebc20538b33 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:41.952045 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-f7b24bb0-d838-409a-a5a5-5fab46ce1184 req-7138f7a9-977d-4b61-93ee-6ebc20538b33 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:41.964343 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-f7b24bb0-d838-409a-a5a5-5fab46ce1184 req-7138f7a9-977d-4b61-93ee-6ebc20538b33 service nova] Creating event network-changed:c5ca791e-ba61-4c19-9ffe-a553a1defb00 for instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 on hv-cinder-81268 Jun 22 18:43:41.970454 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-f7b24bb0-d838-409a-a5a5-5fab46ce1184 req-7138f7a9-977d-4b61-93ee-6ebc20538b33 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034525 Jun 22 18:43:41.971050 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 385/729] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:43:42.047943 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-72fe969f-f7a8-4d8b-9375-6d27acb40f1e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:42.055735 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-72fe969f-f7a8-4d8b-9375-6d27acb40f1e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1676 microversion: 2.1 time: 0.193830 Jun 22 18:43:42.056343 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 345/730] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:41 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:42.404634 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c11cb596-0ef3-474f-9e79-db45b6e86f96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:42.405357 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c11cb596-0ef3-474f-9e79-db45b6e86f96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:42.412011 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c11cb596-0ef3-474f-9e79-db45b6e86f96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:42.412399 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c11cb596-0ef3-474f-9e79-db45b6e86f96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:42.413156 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c11cb596-0ef3-474f-9e79-db45b6e86f96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:42.413582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c11cb596-0ef3-474f-9e79-db45b6e86f96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:42.542703 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c11cb596-0ef3-474f-9e79-db45b6e86f96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:42.546273 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:42.551957 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c11cb596-0ef3-474f-9e79-db45b6e86f96 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.152213 Jun 22 18:43:42.552513 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 386/731] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:42 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:42.700966 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c40e5de8-7237-49d6-8b25-21dfa453fbbf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:42.701493 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c40e5de8-7237-49d6-8b25-21dfa453fbbf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:42.707613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c40e5de8-7237-49d6-8b25-21dfa453fbbf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:42.708089 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c40e5de8-7237-49d6-8b25-21dfa453fbbf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:42.708852 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c40e5de8-7237-49d6-8b25-21dfa453fbbf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:42.709278 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c40e5de8-7237-49d6-8b25-21dfa453fbbf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:42.843384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c40e5de8-7237-49d6-8b25-21dfa453fbbf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:42.850955 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c40e5de8-7237-49d6-8b25-21dfa453fbbf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1367 microversion: 2.1 time: 0.154926 Jun 22 18:43:42.851514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 346/732] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:42 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:43.073136 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-84d6a36d-ca91-4155-92fc-2336b96e8f87 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:43.074263 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-84d6a36d-ca91-4155-92fc-2336b96e8f87 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:43.081155 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-84d6a36d-ca91-4155-92fc-2336b96e8f87 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:43.081617 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-84d6a36d-ca91-4155-92fc-2336b96e8f87 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:43.082368 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-84d6a36d-ca91-4155-92fc-2336b96e8f87 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:43.082800 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-84d6a36d-ca91-4155-92fc-2336b96e8f87 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:43.212759 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-84d6a36d-ca91-4155-92fc-2336b96e8f87 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:43.220703 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-84d6a36d-ca91-4155-92fc-2336b96e8f87 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1676 microversion: 2.1 time: 0.151844 Jun 22 18:43:43.221253 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 387/733] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:43 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:43.569436 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-35f0812e-5da8-449f-b8ad-1504bb2655f8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:43.570038 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-35f0812e-5da8-449f-b8ad-1504bb2655f8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:43.577316 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-35f0812e-5da8-449f-b8ad-1504bb2655f8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:43.577778 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-35f0812e-5da8-449f-b8ad-1504bb2655f8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:43.578529 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-35f0812e-5da8-449f-b8ad-1504bb2655f8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:43.578969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-35f0812e-5da8-449f-b8ad-1504bb2655f8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:43.811872 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-35f0812e-5da8-449f-b8ad-1504bb2655f8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:43.820290 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-35f0812e-5da8-449f-b8ad-1504bb2655f8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.254622 Jun 22 18:43:43.821071 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 347/734] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:43 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:43.867841 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-46f9380b-d925-4466-9c70-0be7df4b9a0b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:43.868470 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-46f9380b-d925-4466-9c70-0be7df4b9a0b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:43.875636 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46f9380b-d925-4466-9c70-0be7df4b9a0b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:43.876118 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46f9380b-d925-4466-9c70-0be7df4b9a0b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:43.876880 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46f9380b-d925-4466-9c70-0be7df4b9a0b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:43.877315 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46f9380b-d925-4466-9c70-0be7df4b9a0b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:44.005832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-46f9380b-d925-4466-9c70-0be7df4b9a0b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:44.014167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-46f9380b-d925-4466-9c70-0be7df4b9a0b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1367 microversion: 2.1 time: 0.150083 Jun 22 18:43:44.014742 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 388/735] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:43 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:44.239395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-94036cc5-1ca3-40b3-83c4-f741314f918e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:44.240025 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-94036cc5-1ca3-40b3-83c4-f741314f918e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:44.246742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94036cc5-1ca3-40b3-83c4-f741314f918e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:44.247214 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94036cc5-1ca3-40b3-83c4-f741314f918e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:44.248034 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94036cc5-1ca3-40b3-83c4-f741314f918e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:44.248426 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-94036cc5-1ca3-40b3-83c4-f741314f918e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:44.676534 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-94036cc5-1ca3-40b3-83c4-f741314f918e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:44.685553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-94036cc5-1ca3-40b3-83c4-f741314f918e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1676 microversion: 2.1 time: 0.450497 Jun 22 18:43:44.686474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 348/736] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:44 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1676 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:43:44.839882 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6d8b7b6d-0902-4c52-acfd-02d57f5b92f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:44.840497 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6d8b7b6d-0902-4c52-acfd-02d57f5b92f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:44.846451 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6d8b7b6d-0902-4c52-acfd-02d57f5b92f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:44.846893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6d8b7b6d-0902-4c52-acfd-02d57f5b92f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:44.847649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6d8b7b6d-0902-4c52-acfd-02d57f5b92f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:44.848110 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6d8b7b6d-0902-4c52-acfd-02d57f5b92f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:44.978477 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6d8b7b6d-0902-4c52-acfd-02d57f5b92f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:44.986419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6d8b7b6d-0902-4c52-acfd-02d57f5b92f0 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.150424 Jun 22 18:43:44.986979 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 389/737] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:44 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:45.030635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-95915cf0-91b5-4df7-9a8a-68be28e9d7e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:45.031234 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-95915cf0-91b5-4df7-9a8a-68be28e9d7e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:45.037121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-95915cf0-91b5-4df7-9a8a-68be28e9d7e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:45.037557 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-95915cf0-91b5-4df7-9a8a-68be28e9d7e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:45.038304 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-95915cf0-91b5-4df7-9a8a-68be28e9d7e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:45.038731 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-95915cf0-91b5-4df7-9a8a-68be28e9d7e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:45.058764 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:45.170426 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-95915cf0-91b5-4df7-9a8a-68be28e9d7e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:45.177801 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-95915cf0-91b5-4df7-9a8a-68be28e9d7e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1367 microversion: 2.1 time: 0.151109 Jun 22 18:43:45.178405 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 349/738] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:45 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:45.704263 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cc97a10c-014d-47e0-b1b7-776beda57d9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:45.704862 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cc97a10c-014d-47e0-b1b7-776beda57d9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:45.710815 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc97a10c-014d-47e0-b1b7-776beda57d9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:45.711256 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc97a10c-014d-47e0-b1b7-776beda57d9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:45.712040 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc97a10c-014d-47e0-b1b7-776beda57d9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:45.712468 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc97a10c-014d-47e0-b1b7-776beda57d9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:45.859733 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cc97a10c-014d-47e0-b1b7-776beda57d9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:45.867270 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cc97a10c-014d-47e0-b1b7-776beda57d9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1676 microversion: 2.1 time: 0.167031 Jun 22 18:43:45.867853 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 390/739] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:45 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:46.003585 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-dc0b696c-9f74-4d49-93ff-97ce5a23022f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:46.004476 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-dc0b696c-9f74-4d49-93ff-97ce5a23022f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:46.010938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dc0b696c-9f74-4d49-93ff-97ce5a23022f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:46.011962 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dc0b696c-9f74-4d49-93ff-97ce5a23022f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:46.012734 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dc0b696c-9f74-4d49-93ff-97ce5a23022f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:46.013169 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dc0b696c-9f74-4d49-93ff-97ce5a23022f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:46.153717 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-dc0b696c-9f74-4d49-93ff-97ce5a23022f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:46.163692 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-dc0b696c-9f74-4d49-93ff-97ce5a23022f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.163921 Jun 22 18:43:46.164287 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 350/740] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:45 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:46.194597 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8ec92e9d-73ea-4a78-b2ca-bd9e75b1b96f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:46.195132 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8ec92e9d-73ea-4a78-b2ca-bd9e75b1b96f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:46.201801 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8ec92e9d-73ea-4a78-b2ca-bd9e75b1b96f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:46.202253 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8ec92e9d-73ea-4a78-b2ca-bd9e75b1b96f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:46.203022 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8ec92e9d-73ea-4a78-b2ca-bd9e75b1b96f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:46.203457 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8ec92e9d-73ea-4a78-b2ca-bd9e75b1b96f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:46.337065 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8ec92e9d-73ea-4a78-b2ca-bd9e75b1b96f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:46.345165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8ec92e9d-73ea-4a78-b2ca-bd9e75b1b96f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1367 microversion: 2.1 time: 0.154627 Jun 22 18:43:46.345722 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 391/741] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:46 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:46.885479 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4956ebe5-35a6-4603-b31e-f67f4ab99932 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:46.885992 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-4956ebe5-35a6-4603-b31e-f67f4ab99932 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:46.892753 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4956ebe5-35a6-4603-b31e-f67f4ab99932 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:46.893196 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4956ebe5-35a6-4603-b31e-f67f4ab99932 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:46.893940 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4956ebe5-35a6-4603-b31e-f67f4ab99932 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:46.894367 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4956ebe5-35a6-4603-b31e-f67f4ab99932 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:47.020408 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4956ebe5-35a6-4603-b31e-f67f4ab99932 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:47.028008 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4956ebe5-35a6-4603-b31e-f67f4ab99932 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1676 microversion: 2.1 time: 0.146360 Jun 22 18:43:47.028516 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 351/742] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:46 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:47.181721 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-544d75fb-3fc7-4d6f-9242-2f269f7ff757 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:47.182325 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-544d75fb-3fc7-4d6f-9242-2f269f7ff757 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:47.189151 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-544d75fb-3fc7-4d6f-9242-2f269f7ff757 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:47.189598 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-544d75fb-3fc7-4d6f-9242-2f269f7ff757 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:47.190354 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-544d75fb-3fc7-4d6f-9242-2f269f7ff757 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:47.190790 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-544d75fb-3fc7-4d6f-9242-2f269f7ff757 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:47.317327 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-544d75fb-3fc7-4d6f-9242-2f269f7ff757 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:47.325806 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-544d75fb-3fc7-4d6f-9242-2f269f7ff757 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1735 microversion: 2.1 time: 0.147389 Jun 22 18:43:47.326366 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 392/743] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:47 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:47.361514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b033591a-4adc-4f6b-b00f-f803df437e05 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:47.362110 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b033591a-4adc-4f6b-b00f-f803df437e05 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:47.368076 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b033591a-4adc-4f6b-b00f-f803df437e05 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:47.368513 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b033591a-4adc-4f6b-b00f-f803df437e05 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:47.369259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b033591a-4adc-4f6b-b00f-f803df437e05 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:47.369686 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b033591a-4adc-4f6b-b00f-f803df437e05 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:47.507309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b033591a-4adc-4f6b-b00f-f803df437e05 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:47.515366 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b033591a-4adc-4f6b-b00f-f803df437e05 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1367 microversion: 2.1 time: 0.157629 Jun 22 18:43:47.515975 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 352/744] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:47 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:48.045627 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b7656d0f-08bf-4c34-bb35-d955d0c1d5c8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:48.046194 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b7656d0f-08bf-4c34-bb35-d955d0c1d5c8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:48.052222 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b7656d0f-08bf-4c34-bb35-d955d0c1d5c8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:48.052668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b7656d0f-08bf-4c34-bb35-d955d0c1d5c8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:48.053426 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b7656d0f-08bf-4c34-bb35-d955d0c1d5c8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:48.053856 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b7656d0f-08bf-4c34-bb35-d955d0c1d5c8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:48.179824 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b7656d0f-08bf-4c34-bb35-d955d0c1d5c8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:48.188102 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b7656d0f-08bf-4c34-bb35-d955d0c1d5c8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1676 microversion: 2.1 time: 0.147024 Jun 22 18:43:48.188682 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 393/745] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:48 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:48.344393 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f29b8995-12c0-4d35-b1ff-b7ee3fafa85e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:48.345684 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f29b8995-12c0-4d35-b1ff-b7ee3fafa85e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:48.352349 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f29b8995-12c0-4d35-b1ff-b7ee3fafa85e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:48.352791 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f29b8995-12c0-4d35-b1ff-b7ee3fafa85e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:48.353549 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f29b8995-12c0-4d35-b1ff-b7ee3fafa85e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:48.354010 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f29b8995-12c0-4d35-b1ff-b7ee3fafa85e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:48.489925 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f29b8995-12c0-4d35-b1ff-b7ee3fafa85e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:48.498702 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f29b8995-12c0-4d35-b1ff-b7ee3fafa85e tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1715 microversion: 2.1 time: 0.158152 Jun 22 18:43:48.499278 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 353/746] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:48 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:48.532420 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-bd574f7f-5456-438f-9593-fb2398312190 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:48.533025 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-bd574f7f-5456-438f-9593-fb2398312190 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:48.539417 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd574f7f-5456-438f-9593-fb2398312190 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:48.539907 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd574f7f-5456-438f-9593-fb2398312190 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:48.540676 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd574f7f-5456-438f-9593-fb2398312190 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:48.541096 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd574f7f-5456-438f-9593-fb2398312190 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:48.558925 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-729853ef-1c64-4405-bfa5-9cb5fbea8f34 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:48.560146 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-729853ef-1c64-4405-bfa5-9cb5fbea8f34 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:48.568536 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-729853ef-1c64-4405-bfa5-9cb5fbea8f34 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:48.569046 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-729853ef-1c64-4405-bfa5-9cb5fbea8f34 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:48.570079 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-729853ef-1c64-4405-bfa5-9cb5fbea8f34 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:48.570516 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-729853ef-1c64-4405-bfa5-9cb5fbea8f34 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:48.689956 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bd574f7f-5456-438f-9593-fb2398312190 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:48.701786 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-bd574f7f-5456-438f-9593-fb2398312190 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1367 microversion: 2.1 time: 0.173327 Jun 22 18:43:48.703032 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 394/747] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:48 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:48.718455 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-729853ef-1c64-4405-bfa5-9cb5fbea8f34 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] HTTP exception thrown: Cannot 'detach_volume' instance 398c2e47-c400-4fc9-9886-3bae472ef7ef while it is in vm_state rescued Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-729853ef-1c64-4405-bfa5-9cb5fbea8f34 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Request method failure captured: Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: DELETE /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-volume_attachments/c7169e0f-3ded-46ef-aba3-c8b6f61dd09e HTTP/1.1 Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GNWSRtAX4FCk4LKPpi2_4oWKg9AzU00FZZox6EKvRPv3yOEoSkqMJkrp8JcBA7WmQt8XgNCQItYQFcBY7IUMtSbG8XqaBpHjESKBr-Rg576Nkmc8jTKetJOWTVZ3d5ny-d34E1fPriTEmE5WqlnluiEkCCfs9w6t1LdNoFGljh4Gc Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: d866c4a659e74e42a3c37050eae82229 Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:43:48.720107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:43:48.721813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d866c4a659e74e42a3c37050eae82229", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:43:48.721813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:43:48.721813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: d866c4a659e74e42a3c37050eae82229 Jun 22 18:43:48.721813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:43:48.721813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-ServerRescueNegativeTestJSON-1877302870-project Jun 22 18:43:48.721813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:43:48.721813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:43:48.721813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 94d5713dc97f442f916b22d925c35042 Jun 22 18:43:48.721813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1877302870-project Jun 22 18:43:48.721813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:43:48.721813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Cannot 'detach_volume' instance 398c2e47-c400-4fc9-9886-3bae472ef7ef while it is in vm_state rescued Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'server_id': '398c2e47-c400-4fc9-9886-3bae472ef7ef', 'id': 'c7169e0f-3ded-46ef-aba3-c8b6f61dd09e'} Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 398c2e47-c400-4fc9-9886-3bae472ef7ef in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:43:48.722573 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 398c2e47-c400-4fc9-9886-3bae472ef7ef while it is in vm_state rescued Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 398c2e47-c400-4fc9-9886-3bae472ef7ef while it is in vm_state rescued Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:43:48.724384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-729853ef-1c64-4405-bfa5-9cb5fbea8f34 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Returning 409 to user: Cannot 'detach_volume' instance 398c2e47-c400-4fc9-9886-3bae472ef7ef while it is in vm_state rescued {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:43:48.725628 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-729853ef-1c64-4405-bfa5-9cb5fbea8f34 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "DELETE /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-volume_attachments/c7169e0f-3ded-46ef-aba3-c8b6f61dd09e" status: 409 len: 152 microversion: 2.1 time: 0.166652 Jun 22 18:43:48.725628 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 354/748] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 18:43:48 2022] DELETE /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-volume_attachments/c7169e0f-3ded-46ef-aba3-c8b6f61dd09e => generated 152 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 18:43:48.732119 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ed4f4877-b6ab-4ead-9784-31767ad63e65 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:43:48.732646 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ed4f4877-b6ab-4ead-9784-31767ad63e65 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:48.739469 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ed4f4877-b6ab-4ead-9784-31767ad63e65 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:48.739958 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ed4f4877-b6ab-4ead-9784-31767ad63e65 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:48.740999 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ed4f4877-b6ab-4ead-9784-31767ad63e65 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:48.741437 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ed4f4877-b6ab-4ead-9784-31767ad63e65 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:48.815061 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ed4f4877-b6ab-4ead-9784-31767ad63e65 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "POST /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/action" status: 202 len: 0 microversion: 2.1 time: 0.087292 Jun 22 18:43:48.818829 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 395/749] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:43:48 2022] POST /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:43:48.827281 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7dd2fada-734f-4813-b2e7-4a06b02b9d15 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:48.828202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7dd2fada-734f-4813-b2e7-4a06b02b9d15 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:48.834939 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7dd2fada-734f-4813-b2e7-4a06b02b9d15 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:48.835650 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7dd2fada-734f-4813-b2e7-4a06b02b9d15 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:48.836600 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7dd2fada-734f-4813-b2e7-4a06b02b9d15 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:48.837022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7dd2fada-734f-4813-b2e7-4a06b02b9d15 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:49.063917 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7dd2fada-734f-4813-b2e7-4a06b02b9d15 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:49.072572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7dd2fada-734f-4813-b2e7-4a06b02b9d15 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1723 microversion: 2.1 time: 0.252402 Jun 22 18:43:49.073069 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 355/750] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:48 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:49.205232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e3d93997-63c3-485d-83d6-ac4853e52dda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:49.205923 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e3d93997-63c3-485d-83d6-ac4853e52dda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:49.212803 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e3d93997-63c3-485d-83d6-ac4853e52dda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:49.213248 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e3d93997-63c3-485d-83d6-ac4853e52dda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:49.214332 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e3d93997-63c3-485d-83d6-ac4853e52dda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:49.214457 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e3d93997-63c3-485d-83d6-ac4853e52dda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:49.349735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e3d93997-63c3-485d-83d6-ac4853e52dda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:49.357936 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e3d93997-63c3-485d-83d6-ac4853e52dda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1676 microversion: 2.1 time: 0.157150 Jun 22 18:43:49.358608 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 396/751] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:49 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:49.719520 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-961ddb6f-df8f-4bdf-9b87-0fdbb727149d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:49.720155 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-961ddb6f-df8f-4bdf-9b87-0fdbb727149d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:49.721982 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:49.722641 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=10 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:49.729524 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-961ddb6f-df8f-4bdf-9b87-0fdbb727149d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:49.729970 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-961ddb6f-df8f-4bdf-9b87-0fdbb727149d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:49.730727 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-961ddb6f-df8f-4bdf-9b87-0fdbb727149d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:49.731476 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-961ddb6f-df8f-4bdf-9b87-0fdbb727149d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:49.863637 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-961ddb6f-df8f-4bdf-9b87-0fdbb727149d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:49.870758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-961ddb6f-df8f-4bdf-9b87-0fdbb727149d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1367 microversion: 2.1 time: 0.156088 Jun 22 18:43:49.871319 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 356/752] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:49 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:50.089370 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d8b57a43-160c-44a0-a42d-26fabe124294 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:50.089972 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d8b57a43-160c-44a0-a42d-26fabe124294 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:50.092036 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:50.097609 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d8b57a43-160c-44a0-a42d-26fabe124294 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:50.098044 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d8b57a43-160c-44a0-a42d-26fabe124294 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:50.098796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d8b57a43-160c-44a0-a42d-26fabe124294 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:50.099223 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d8b57a43-160c-44a0-a42d-26fabe124294 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:50.229641 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d8b57a43-160c-44a0-a42d-26fabe124294 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:50.238282 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d8b57a43-160c-44a0-a42d-26fabe124294 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1723 microversion: 2.1 time: 0.152741 Jun 22 18:43:50.238844 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 397/753] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:50 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:50.374388 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a4ca499d-775f-4b61-9f99-e02e48a0a7ac tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:50.375286 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a4ca499d-775f-4b61-9f99-e02e48a0a7ac tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:50.381823 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a4ca499d-775f-4b61-9f99-e02e48a0a7ac tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:50.382259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a4ca499d-775f-4b61-9f99-e02e48a0a7ac tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:50.383013 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a4ca499d-775f-4b61-9f99-e02e48a0a7ac tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:50.383447 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a4ca499d-775f-4b61-9f99-e02e48a0a7ac tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:50.509278 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a4ca499d-775f-4b61-9f99-e02e48a0a7ac tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:50.517724 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a4ca499d-775f-4b61-9f99-e02e48a0a7ac tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1676 microversion: 2.1 time: 0.146844 Jun 22 18:43:50.517915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 357/754] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:50 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:50.676506 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-71234e27-b963-457c-991c-d849eda438a2 req-69b2ab37-c870-4d56-9ab9-4063bd4dbee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2", "name": "network-vif-plugged", "status": "completed", "tag": "c5ca791e-ba61-4c19-9ffe-a553a1defb00"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:43:50.685550 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-71234e27-b963-457c-991c-d849eda438a2 req-69b2ab37-c870-4d56-9ab9-4063bd4dbee4 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:50.686187 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-71234e27-b963-457c-991c-d849eda438a2 req-69b2ab37-c870-4d56-9ab9-4063bd4dbee4 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:50.698466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-71234e27-b963-457c-991c-d849eda438a2 req-69b2ab37-c870-4d56-9ab9-4063bd4dbee4 service nova] Creating event network-vif-plugged:c5ca791e-ba61-4c19-9ffe-a553a1defb00 for instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 on hv-cinder-81268 Jun 22 18:43:50.704445 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-71234e27-b963-457c-991c-d849eda438a2 req-69b2ab37-c870-4d56-9ab9-4063bd4dbee4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031611 Jun 22 18:43:50.705203 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 398/755] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:43:50.889874 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d1c4fbcb-e83d-4cae-9cb2-bd1f89b85084 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:50.890477 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d1c4fbcb-e83d-4cae-9cb2-bd1f89b85084 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:50.896984 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d1c4fbcb-e83d-4cae-9cb2-bd1f89b85084 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:50.897422 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d1c4fbcb-e83d-4cae-9cb2-bd1f89b85084 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:50.898176 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d1c4fbcb-e83d-4cae-9cb2-bd1f89b85084 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:50.898605 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d1c4fbcb-e83d-4cae-9cb2-bd1f89b85084 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:51.027237 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d1c4fbcb-e83d-4cae-9cb2-bd1f89b85084 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:51.034752 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d1c4fbcb-e83d-4cae-9cb2-bd1f89b85084 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1367 microversion: 2.1 time: 0.149351 Jun 22 18:43:51.035309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 358/756] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:50 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:51.258182 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1d9aba8c-6dff-473d-8c83-465966a4bbf6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:51.258865 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-1d9aba8c-6dff-473d-8c83-465966a4bbf6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:51.265564 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1d9aba8c-6dff-473d-8c83-465966a4bbf6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:51.266005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1d9aba8c-6dff-473d-8c83-465966a4bbf6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:51.266762 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1d9aba8c-6dff-473d-8c83-465966a4bbf6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:51.267191 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1d9aba8c-6dff-473d-8c83-465966a4bbf6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:51.394012 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-1d9aba8c-6dff-473d-8c83-465966a4bbf6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:51.401989 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-1d9aba8c-6dff-473d-8c83-465966a4bbf6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1723 microversion: 2.1 time: 0.148558 Jun 22 18:43:51.402554 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 399/757] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:51 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:51.535230 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-cc2e9287-94ae-4797-9cdf-137e1c44faaf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:51.535759 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-cc2e9287-94ae-4797-9cdf-137e1c44faaf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:51.541817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cc2e9287-94ae-4797-9cdf-137e1c44faaf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:51.542257 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cc2e9287-94ae-4797-9cdf-137e1c44faaf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:51.543019 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cc2e9287-94ae-4797-9cdf-137e1c44faaf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:51.544149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cc2e9287-94ae-4797-9cdf-137e1c44faaf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:51.670949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cc2e9287-94ae-4797-9cdf-137e1c44faaf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:51.678324 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-cc2e9287-94ae-4797-9cdf-137e1c44faaf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1676 microversion: 2.1 time: 0.147033 Jun 22 18:43:51.678876 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 359/758] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:51 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:43:52.051992 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-facb9383-297d-4619-839b-480658da3e50 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:52.052605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-facb9383-297d-4619-839b-480658da3e50 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:52.058661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-facb9383-297d-4619-839b-480658da3e50 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:52.059250 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-facb9383-297d-4619-839b-480658da3e50 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:52.060140 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-facb9383-297d-4619-839b-480658da3e50 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:52.060580 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-facb9383-297d-4619-839b-480658da3e50 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:52.191487 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-facb9383-297d-4619-839b-480658da3e50 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:52.198849 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-facb9383-297d-4619-839b-480658da3e50 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1367 microversion: 2.1 time: 0.150704 Jun 22 18:43:52.199403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 400/759] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:52 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:52.419221 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1d098e2f-db41-4fd7-b340-4de99bf2e271 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:52.419850 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1d098e2f-db41-4fd7-b340-4de99bf2e271 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:52.426523 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1d098e2f-db41-4fd7-b340-4de99bf2e271 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:52.426973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1d098e2f-db41-4fd7-b340-4de99bf2e271 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:52.427741 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1d098e2f-db41-4fd7-b340-4de99bf2e271 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:52.428205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1d098e2f-db41-4fd7-b340-4de99bf2e271 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:52.562294 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1d098e2f-db41-4fd7-b340-4de99bf2e271 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:52.570319 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1d098e2f-db41-4fd7-b340-4de99bf2e271 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1723 microversion: 2.1 time: 0.154961 Jun 22 18:43:52.570823 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 360/760] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:52 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:52.695270 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-09725cc7-4007-4d5f-b5e4-5b939363ceda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:52.695930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-09725cc7-4007-4d5f-b5e4-5b939363ceda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:52.698370 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=61 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:52.704269 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-09725cc7-4007-4d5f-b5e4-5b939363ceda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:52.704720 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-09725cc7-4007-4d5f-b5e4-5b939363ceda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:52.705482 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-09725cc7-4007-4d5f-b5e4-5b939363ceda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:52.705914 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-09725cc7-4007-4d5f-b5e4-5b939363ceda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:52.831982 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-09725cc7-4007-4d5f-b5e4-5b939363ceda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:52.839412 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-09725cc7-4007-4d5f-b5e4-5b939363ceda tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1676 microversion: 2.1 time: 0.147982 Jun 22 18:43:52.840010 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 401/761] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:52 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:53.217671 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-16b93454-6de9-49f1-8c68-e57ecfa01753 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:53.218621 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-16b93454-6de9-49f1-8c68-e57ecfa01753 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:53.225463 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-16b93454-6de9-49f1-8c68-e57ecfa01753 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:53.226040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-16b93454-6de9-49f1-8c68-e57ecfa01753 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:53.226914 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-16b93454-6de9-49f1-8c68-e57ecfa01753 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:53.227454 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-16b93454-6de9-49f1-8c68-e57ecfa01753 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:53.360356 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-16b93454-6de9-49f1-8c68-e57ecfa01753 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:53.367811 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-16b93454-6de9-49f1-8c68-e57ecfa01753 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1367 microversion: 2.1 time: 0.154911 Jun 22 18:43:53.368404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 361/762] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:53 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:53.587234 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-739154e7-a85d-4e05-a775-3487869c0772 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:53.587857 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-739154e7-a85d-4e05-a775-3487869c0772 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:53.594279 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-739154e7-a85d-4e05-a775-3487869c0772 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:53.594726 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-739154e7-a85d-4e05-a775-3487869c0772 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:53.595485 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-739154e7-a85d-4e05-a775-3487869c0772 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:53.595944 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-739154e7-a85d-4e05-a775-3487869c0772 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:53.726749 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-739154e7-a85d-4e05-a775-3487869c0772 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:53.735339 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-739154e7-a85d-4e05-a775-3487869c0772 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1729 microversion: 2.1 time: 0.151980 Jun 22 18:43:53.736331 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 402/763] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:53 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:53.752674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ccc6c80d-e46f-4d63-ba06-bac86dd25df7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:53.753195 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ccc6c80d-e46f-4d63-ba06-bac86dd25df7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:53.759788 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ccc6c80d-e46f-4d63-ba06-bac86dd25df7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:53.760263 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ccc6c80d-e46f-4d63-ba06-bac86dd25df7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:53.761017 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ccc6c80d-e46f-4d63-ba06-bac86dd25df7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:53.761472 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ccc6c80d-e46f-4d63-ba06-bac86dd25df7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:53.839445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ccc6c80d-e46f-4d63-ba06-bac86dd25df7 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090801 Jun 22 18:43:53.840530 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 362/764] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 18:43:53 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:43:53.856593 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-03dfea3c-ae90-404f-a557-7f6691e9c6b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:53.857222 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-03dfea3c-ae90-404f-a557-7f6691e9c6b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:53.863239 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-03dfea3c-ae90-404f-a557-7f6691e9c6b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:53.863684 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-03dfea3c-ae90-404f-a557-7f6691e9c6b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:53.864472 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-03dfea3c-ae90-404f-a557-7f6691e9c6b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:53.864902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-03dfea3c-ae90-404f-a557-7f6691e9c6b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:53.868897 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:54.004876 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-03dfea3c-ae90-404f-a557-7f6691e9c6b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:54.012731 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-03dfea3c-ae90-404f-a557-7f6691e9c6b6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1653 microversion: 2.1 time: 0.160253 Jun 22 18:43:54.013386 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 403/765] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:53 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1653 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:54.028934 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e4f83fcc-2489-4020-ad10-5afa2fa88918 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:43:54.030848 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:54.036274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e4f83fcc-2489-4020-ad10-5afa2fa88918 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:54.036722 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e4f83fcc-2489-4020-ad10-5afa2fa88918 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:54.061705 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e4f83fcc-2489-4020-ad10-5afa2fa88918 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Going to try to start instance {{(pid=129743) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 18:43:54.105267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e4f83fcc-2489-4020-ad10-5afa2fa88918 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "POST /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/action" status: 202 len: 0 microversion: 2.1 time: 0.079879 Jun 22 18:43:54.105794 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 363/766] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:43:54 2022] POST /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:43:54.113972 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7a71742b-a56a-4adb-83b4-1c7c0b28b935 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:54.114579 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7a71742b-a56a-4adb-83b4-1c7c0b28b935 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:54.124375 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7a71742b-a56a-4adb-83b4-1c7c0b28b935 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:54.124653 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7a71742b-a56a-4adb-83b4-1c7c0b28b935 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:54.125439 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7a71742b-a56a-4adb-83b4-1c7c0b28b935 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:54.125880 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7a71742b-a56a-4adb-83b4-1c7c0b28b935 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:54.271484 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7a71742b-a56a-4adb-83b4-1c7c0b28b935 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:54.283902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7a71742b-a56a-4adb-83b4-1c7c0b28b935 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1662 microversion: 2.1 time: 0.173515 Jun 22 18:43:54.285080 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 404/767] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:54 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1662 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:54.386438 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7a75e0a6-f583-4d93-96a6-196033fd3a4f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:54.387766 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7a75e0a6-f583-4d93-96a6-196033fd3a4f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:54.394208 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7a75e0a6-f583-4d93-96a6-196033fd3a4f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:54.394658 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7a75e0a6-f583-4d93-96a6-196033fd3a4f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:54.395429 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7a75e0a6-f583-4d93-96a6-196033fd3a4f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:54.395887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7a75e0a6-f583-4d93-96a6-196033fd3a4f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:54.710250 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7a75e0a6-f583-4d93-96a6-196033fd3a4f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:54.718626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7a75e0a6-f583-4d93-96a6-196033fd3a4f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1557 microversion: 2.1 time: 0.336629 Jun 22 18:43:54.719516 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 364/768] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:54 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1557 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:54.735186 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f3b293ee-017b-45ac-9547-6e806acf5f76 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:54.735725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f3b293ee-017b-45ac-9547-6e806acf5f76 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:54.742138 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f3b293ee-017b-45ac-9547-6e806acf5f76 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:54.742580 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f3b293ee-017b-45ac-9547-6e806acf5f76 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:54.743335 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f3b293ee-017b-45ac-9547-6e806acf5f76 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:54.743765 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f3b293ee-017b-45ac-9547-6e806acf5f76 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:54.824312 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f3b293ee-017b-45ac-9547-6e806acf5f76 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093339 Jun 22 18:43:54.825492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 405/769] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 18:43:54 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:43:55.229074 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-97ce85a5-13c3-4ff8-b859-fea6399380c6 req-2fa524bc-6ee3-4ff0-af6e-06640fd53326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398c2e47-c400-4fc9-9886-3bae472ef7ef", "tag": "82a54d97-7875-47e7-82fc-49324718c1f0"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:43:55.243135 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-97ce85a5-13c3-4ff8-b859-fea6399380c6 req-2fa524bc-6ee3-4ff0-af6e-06640fd53326 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:55.243982 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-97ce85a5-13c3-4ff8-b859-fea6399380c6 req-2fa524bc-6ee3-4ff0-af6e-06640fd53326 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:55.261172 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-97ce85a5-13c3-4ff8-b859-fea6399380c6 req-2fa524bc-6ee3-4ff0-af6e-06640fd53326 service nova] Creating event network-changed:82a54d97-7875-47e7-82fc-49324718c1f0 for instance 398c2e47-c400-4fc9-9886-3bae472ef7ef on hv-cinder-81268 Jun 22 18:43:55.267720 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-97ce85a5-13c3-4ff8-b859-fea6399380c6 req-2fa524bc-6ee3-4ff0-af6e-06640fd53326 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138007 Jun 22 18:43:55.269000 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 365/770] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:43:55.302461 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-703e31fd-306d-4c63-a906-bc0e6ac1b4f8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:55.303513 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-703e31fd-306d-4c63-a906-bc0e6ac1b4f8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:55.312832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-703e31fd-306d-4c63-a906-bc0e6ac1b4f8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:55.313796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-703e31fd-306d-4c63-a906-bc0e6ac1b4f8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:55.314789 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-703e31fd-306d-4c63-a906-bc0e6ac1b4f8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:55.315416 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-703e31fd-306d-4c63-a906-bc0e6ac1b4f8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:55.574451 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-703e31fd-306d-4c63-a906-bc0e6ac1b4f8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:55.587270 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-703e31fd-306d-4c63-a906-bc0e6ac1b4f8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1662 microversion: 2.1 time: 0.288462 Jun 22 18:43:55.588079 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 406/771] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:55 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1662 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:55.863453 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 18:43:55.864877 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Wed Jun 22 18:43:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 18:43:56.209262 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-2a376e85-f28f-4007-b0e6-88bc72a67fb8 req-009b4dab-9738-45a9-8e6f-26b0d97851cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2", "tag": "c5ca791e-ba61-4c19-9ffe-a553a1defb00"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:43:56.218605 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-2a376e85-f28f-4007-b0e6-88bc72a67fb8 req-009b4dab-9738-45a9-8e6f-26b0d97851cb service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:56.219048 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-2a376e85-f28f-4007-b0e6-88bc72a67fb8 req-009b4dab-9738-45a9-8e6f-26b0d97851cb service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:56.222941 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:43:56.233820 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-2a376e85-f28f-4007-b0e6-88bc72a67fb8 req-009b4dab-9738-45a9-8e6f-26b0d97851cb service nova] Creating event network-changed:c5ca791e-ba61-4c19-9ffe-a553a1defb00 for instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 on hv-cinder-81268 Jun 22 18:43:56.238608 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-2a376e85-f28f-4007-b0e6-88bc72a67fb8 req-009b4dab-9738-45a9-8e6f-26b0d97851cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089816 Jun 22 18:43:56.239201 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 366/772] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:43:56.607377 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-22a10022-d7e8-48cd-b6fa-29df74200313 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:43:56.607897 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-22a10022-d7e8-48cd-b6fa-29df74200313 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:43:56.615397 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-22a10022-d7e8-48cd-b6fa-29df74200313 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:56.615875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-22a10022-d7e8-48cd-b6fa-29df74200313 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:56.616638 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-22a10022-d7e8-48cd-b6fa-29df74200313 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:56.617065 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-22a10022-d7e8-48cd-b6fa-29df74200313 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:56.781699 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-22a10022-d7e8-48cd-b6fa-29df74200313 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:43:56.789302 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-22a10022-d7e8-48cd-b6fa-29df74200313 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1666 microversion: 2.1 time: 0.187924 Jun 22 18:43:56.789859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 407/773] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:43:56 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1666 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:43:57.284445 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-cb940b50-61dd-4e94-9d7b-a032118c2860 req-4d7881e8-722b-48e9-b21d-8b31e7ebe426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398c2e47-c400-4fc9-9886-3bae472ef7ef", "tag": "82a54d97-7875-47e7-82fc-49324718c1f0"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:43:57.293810 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-cb940b50-61dd-4e94-9d7b-a032118c2860 req-4d7881e8-722b-48e9-b21d-8b31e7ebe426 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:43:57.294246 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-cb940b50-61dd-4e94-9d7b-a032118c2860 req-4d7881e8-722b-48e9-b21d-8b31e7ebe426 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:43:57.305159 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-cb940b50-61dd-4e94-9d7b-a032118c2860 req-4d7881e8-722b-48e9-b21d-8b31e7ebe426 service nova] Creating event network-changed:82a54d97-7875-47e7-82fc-49324718c1f0 for instance 398c2e47-c400-4fc9-9886-3bae472ef7ef on hv-cinder-81268 Jun 22 18:43:57.310025 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-cb940b50-61dd-4e94-9d7b-a032118c2860 req-4d7881e8-722b-48e9-b21d-8b31e7ebe426 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030070 Jun 22 18:43:57.310598 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 367/774] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:44:07.373772 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=13 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:07.374543 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=26 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:07.473228 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c7211e55-8535-482f-9bae-12235ca6d493 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:07.473722 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c7211e55-8535-482f-9bae-12235ca6d493 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:07.479697 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c7211e55-8535-482f-9bae-12235ca6d493 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:07.480174 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c7211e55-8535-482f-9bae-12235ca6d493 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:07.480934 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c7211e55-8535-482f-9bae-12235ca6d493 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:07.481367 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c7211e55-8535-482f-9bae-12235ca6d493 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:07.510111 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c7211e55-8535-482f-9bae-12235ca6d493 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/os-volume_attachments/e7575ff3-eebb-4ece-bb2e-6976ff672f6a" status: 200 len: 194 microversion: 2.20 time: 0.141568 Jun 22 18:44:07.510659 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 408/775] 10.222.0.18 () {60 vars in 1453 bytes} [Wed Jun 22 18:44:07 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/os-volume_attachments/e7575ff3-eebb-4ece-bb2e-6976ff672f6a => generated 194 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:44:07.572790 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=9 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:07.573526 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:07.578604 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-21b5d5e7-b49c-4b42-be88-aba852e832ee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:07.579182 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-21b5d5e7-b49c-4b42-be88-aba852e832ee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:07.586042 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-21b5d5e7-b49c-4b42-be88-aba852e832ee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:07.586470 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-21b5d5e7-b49c-4b42-be88-aba852e832ee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:07.587228 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-21b5d5e7-b49c-4b42-be88-aba852e832ee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:07.587662 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-21b5d5e7-b49c-4b42-be88-aba852e832ee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:07.667490 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.objects.instance [None req-21b5d5e7-b49c-4b42-be88-aba852e832ee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lazy-loading 'services' on Instance uuid 688c6da6-d454-4dc0-8335-b0a4e16f5824 {{(pid=129743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:44:07.780098 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-21b5d5e7-b49c-4b42-be88-aba852e832ee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "DELETE /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/os-volume_attachments/e7575ff3-eebb-4ece-bb2e-6976ff672f6a" status: 202 len: 0 microversion: 2.20 time: 0.208717 Jun 22 18:44:07.780689 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 368/776] 10.222.0.18 () {60 vars in 1456 bytes} [Wed Jun 22 18:44:07 2022] DELETE /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/os-volume_attachments/e7575ff3-eebb-4ece-bb2e-6976ff672f6a => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:44:07.789065 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6b8f792c-5082-4cd1-879e-63db01a368bb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:07.790110 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6b8f792c-5082-4cd1-879e-63db01a368bb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:07.796628 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6b8f792c-5082-4cd1-879e-63db01a368bb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:07.797068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6b8f792c-5082-4cd1-879e-63db01a368bb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:07.797819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6b8f792c-5082-4cd1-879e-63db01a368bb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:07.798245 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6b8f792c-5082-4cd1-879e-63db01a368bb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:07.828714 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6b8f792c-5082-4cd1-879e-63db01a368bb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043534 Jun 22 18:44:07.829286 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 409/777] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jun 22 18:44:07 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:44:08.841787 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-8272d437-fcd5-4c8a-b5bd-fbf9814a3fe0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:08.842783 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-8272d437-fcd5-4c8a-b5bd-fbf9814a3fe0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:08.849006 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8272d437-fcd5-4c8a-b5bd-fbf9814a3fe0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:08.849447 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8272d437-fcd5-4c8a-b5bd-fbf9814a3fe0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:08.850202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8272d437-fcd5-4c8a-b5bd-fbf9814a3fe0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:08.850633 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8272d437-fcd5-4c8a-b5bd-fbf9814a3fe0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:08.880347 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-8272d437-fcd5-4c8a-b5bd-fbf9814a3fe0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043662 Jun 22 18:44:08.880897 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 369/778] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jun 22 18:44:08 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:08.937888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9b7ee611-2b1a-4b12-87fe-0a1033e0aa2b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:08.938385 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9b7ee611-2b1a-4b12-87fe-0a1033e0aa2b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:08.944815 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9b7ee611-2b1a-4b12-87fe-0a1033e0aa2b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:08.945281 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9b7ee611-2b1a-4b12-87fe-0a1033e0aa2b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:08.946032 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9b7ee611-2b1a-4b12-87fe-0a1033e0aa2b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:08.946474 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9b7ee611-2b1a-4b12-87fe-0a1033e0aa2b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:08.971542 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9b7ee611-2b1a-4b12-87fe-0a1033e0aa2b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Going to try to terminate instance {{(pid=129744) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:44:09.047253 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9b7ee611-2b1a-4b12-87fe-0a1033e0aa2b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "DELETE /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 204 len: 0 microversion: 2.20 time: 0.113543 Jun 22 18:44:09.047913 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 410/779] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jun 22 18:44:08 2022] DELETE /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 18:44:09.056131 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-11020830-9358-4d2f-a56d-94e4ec4c9a3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:09.056896 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-11020830-9358-4d2f-a56d-94e4ec4c9a3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:09.063662 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-11020830-9358-4d2f-a56d-94e4ec4c9a3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:09.064134 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-11020830-9358-4d2f-a56d-94e4ec4c9a3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:09.064899 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-11020830-9358-4d2f-a56d-94e4ec4c9a3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:09.065331 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-11020830-9358-4d2f-a56d-94e4ec4c9a3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:09.201206 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-11020830-9358-4d2f-a56d-94e4ec4c9a3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:09.209476 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-11020830-9358-4d2f-a56d-94e4ec4c9a3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:09.210972 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-11020830-9358-4d2f-a56d-94e4ec4c9a3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:09.212140 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-11020830-9358-4d2f-a56d-94e4ec4c9a3b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.159877 Jun 22 18:44:09.212700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 370/780] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:09 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:44:10.230998 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ea880da4-ce87-450c-9800-55630e503190 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:10.231794 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ea880da4-ce87-450c-9800-55630e503190 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:10.238275 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ea880da4-ce87-450c-9800-55630e503190 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:10.238714 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ea880da4-ce87-450c-9800-55630e503190 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:10.239466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ea880da4-ce87-450c-9800-55630e503190 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:10.239916 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ea880da4-ce87-450c-9800-55630e503190 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:10.370472 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ea880da4-ce87-450c-9800-55630e503190 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:10.379104 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ea880da4-ce87-450c-9800-55630e503190 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:10.380639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ea880da4-ce87-450c-9800-55630e503190 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:10.382326 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ea880da4-ce87-450c-9800-55630e503190 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.155155 Jun 22 18:44:10.382326 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 411/781] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:10 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:44:11.401382 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-0fa63ecd-dc51-4671-8048-5181014d154f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:11.402087 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0fa63ecd-dc51-4671-8048-5181014d154f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:11.409385 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0fa63ecd-dc51-4671-8048-5181014d154f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:11.409856 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0fa63ecd-dc51-4671-8048-5181014d154f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:11.410613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0fa63ecd-dc51-4671-8048-5181014d154f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:11.411039 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0fa63ecd-dc51-4671-8048-5181014d154f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:11.656974 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-0fa63ecd-dc51-4671-8048-5181014d154f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:11.664874 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-0fa63ecd-dc51-4671-8048-5181014d154f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:11.666367 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-0fa63ecd-dc51-4671-8048-5181014d154f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:11.667496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-0fa63ecd-dc51-4671-8048-5181014d154f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 200 len: 1722 microversion: 2.20 time: 0.270032 Jun 22 18:44:11.668078 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 371/782] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:11 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:44:12.092604 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-df5d4c8f-3653-4fb0-bdb7-f3a5aeb101c2 req-db84be94-6c2d-4518-b6ec-7f8fbec1ad0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688c6da6-d454-4dc0-8335-b0a4e16f5824", "name": "network-vif-deleted", "tag": "24070ee1-9191-4d52-8234-91ae16aa72a0"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:44:12.101426 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-df5d4c8f-3653-4fb0-bdb7-f3a5aeb101c2 req-db84be94-6c2d-4518-b6ec-7f8fbec1ad0f service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:12.102220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-df5d4c8f-3653-4fb0-bdb7-f3a5aeb101c2 req-db84be94-6c2d-4518-b6ec-7f8fbec1ad0f service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:12.115596 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-df5d4c8f-3653-4fb0-bdb7-f3a5aeb101c2 req-db84be94-6c2d-4518-b6ec-7f8fbec1ad0f service nova] Creating event network-vif-deleted:24070ee1-9191-4d52-8234-91ae16aa72a0 for instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 on hv-cinder-81268 Jun 22 18:44:12.121886 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-df5d4c8f-3653-4fb0-bdb7-f3a5aeb101c2 req-db84be94-6c2d-4518-b6ec-7f8fbec1ad0f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033624 Jun 22 18:44:12.123414 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 412/783] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:44:12.687240 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f5caae81-75eb-4168-bb52-ac118c68410a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:12.687785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f5caae81-75eb-4168-bb52-ac118c68410a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:12.694503 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5caae81-75eb-4168-bb52-ac118c68410a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:12.695552 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5caae81-75eb-4168-bb52-ac118c68410a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:12.696374 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5caae81-75eb-4168-bb52-ac118c68410a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:12.696811 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5caae81-75eb-4168-bb52-ac118c68410a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:12.710795 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-f5caae81-75eb-4168-bb52-ac118c68410a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] HTTP exception thrown: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f5caae81-75eb-4168-bb52-ac118c68410a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Request method failure captured: Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 HTTP/1.1 Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GMNVVijv6NFrZXVk60QuvtN4TVQ9Cc-S-SaR6g-aSlefiS2lHfhM-yCKj-50B3bn-mxIDEKPapluuF_DwUMwyg1STapeS4ocHStk3bSjCpmQCMLEX_2aMyoz4OqNKVgnIxzVKL4lIWpZg1p7BARHUWtjVuyk0CFlk3258Hj2BxQRc Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: bd1ef211ea584b0abd50b02208966d7a Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:44:12.712532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:44:12.714251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bd1ef211ea584b0abd50b02208966d7a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:44:12.714251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:44:12.714251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: bd1ef211ea584b0abd50b02208966d7a Jun 22 18:44:12.714251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:44:12.714251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeShelveTestJSON-1352239561-project Jun 22 18:44:12.714251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:44:12.714251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:44:12.714251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 8978ed54252843f78b0d00d37b475ad2 Jun 22 18:44:12.714251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1352239561-project Jun 22 18:44:12.714251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:44:12.714251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:44:12.714251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '688c6da6-d454-4dc0-8335-b0a4e16f5824'} Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:44:12.715205 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:44:12.716711 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:44:12.718115 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f5caae81-75eb-4168-bb52-ac118c68410a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Returning 404 to user: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:44:12.718115 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f5caae81-75eb-4168-bb52-ac118c68410a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 404 len: 111 microversion: 2.20 time: 0.031292 Jun 22 18:44:12.718115 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 372/784] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:12 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 18:44:12.730850 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f1513c69-815e-4082-bc68-a01938205bd0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '.version_select at 0x7fd7554cef70>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:12.761522 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f1513c69-815e-4082-bc68-a01938205bd0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035708385" status: 204 len: 0 microversion: 2.20 time: 0.037616 Jun 22 18:44:12.762482 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 413/785] 10.222.0.18 () {60 vars in 1261 bytes} [Wed Jun 22 18:44:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035708385 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 18:44:13.457976 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-09adb01e-1845-4869-ba3b-7e9bcb5fb23c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Action: 'create', calling method: .version_select at 0x7fd7554711f0>, body: {"keypair": {"name": "tempest-keypair-1606041215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnAgGMCtTiL3JbZODU747CQZOVlhCLnVxqlLQLJolHZB7LGg97jvdZPdpgLlpFnrNDCP90Pl/3rjF4Y9J8vBCzbj7zhP9qEGfOxcVcwlr02FJwz1ub9ZPHjwpvzDZfN8Q=="}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:44:13.473679 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-09adb01e-1845-4869-ba3b-7e9bcb5fb23c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Getting quotas for project bd1ef211ea584b0abd50b02208966d7a. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:44:13.477705 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-09adb01e-1845-4869-ba3b-7e9bcb5fb23c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Getting quotas for user 8978ed54252843f78b0d00d37b475ad2 and project bd1ef211ea584b0abd50b02208966d7a. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:44:13.500870 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-09adb01e-1845-4869-ba3b-7e9bcb5fb23c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046805 Jun 22 18:44:13.501461 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 373/786] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Jun 22 18:44:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 18:44:14.647592 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1795279566", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e36f357-f184-4666-b4f8-3b7e32281f23"}], "security_groups": [{"name": "tempest-securitygroup--1655102091"}], "key_name": "tempest-keypair-1606041215", "user_data": "}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:44:14.756071 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.network.neutron [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] validate_networks() for [('3e36f357-f184-4666-b4f8-3b7e32281f23', None, None, None, None, None)] {{(pid=129744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:44:15.152720 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Flavor limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:44:15.153174 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Image limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:44:15.154200 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Flavor pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:44:15.154607 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Image pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:44:15.155019 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:44:15.163773 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:15.164249 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:15.165050 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:15.165486 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:15.181993 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Getting quotas for project bd1ef211ea584b0abd50b02208966d7a. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:44:15.186197 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Getting quotas for user 8978ed54252843f78b0d00d37b475ad2 and project bd1ef211ea584b0abd50b02208966d7a. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:44:15.197114 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Going to run 1 instances... {{(pid=129744) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:44:15.199444 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:44:15.246094 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-facb4a4b-99b5-473a-a511-8b5b261be060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.602760 Jun 22 18:44:15.246739 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 414/787] 10.222.0.18 () {62 vars in 1187 bytes} [Wed Jun 22 18:44:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 18:44:15.257472 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-771ff459-8906-45b3-ba8b-d5c25dccfda8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:15.258081 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-771ff459-8906-45b3-ba8b-d5c25dccfda8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:15.312026 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-771ff459-8906-45b3-ba8b-d5c25dccfda8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:15.320953 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-771ff459-8906-45b3-ba8b-d5c25dccfda8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:15.322467 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-771ff459-8906-45b3-ba8b-d5c25dccfda8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:15.324250 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-771ff459-8906-45b3-ba8b-d5c25dccfda8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1282 microversion: 2.20 time: 0.070725 Jun 22 18:44:15.324878 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 374/788] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:15 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:44:16.344749 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-dd7500fc-ee30-4db1-8495-7d588f71e4af tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:16.346513 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-dd7500fc-ee30-4db1-8495-7d588f71e4af tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:16.354518 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd7500fc-ee30-4db1-8495-7d588f71e4af tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:16.354962 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd7500fc-ee30-4db1-8495-7d588f71e4af tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:16.355723 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd7500fc-ee30-4db1-8495-7d588f71e4af tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:16.356224 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd7500fc-ee30-4db1-8495-7d588f71e4af tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:16.426787 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dd7500fc-ee30-4db1-8495-7d588f71e4af tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:16.437732 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dd7500fc-ee30-4db1-8495-7d588f71e4af tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:16.439498 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dd7500fc-ee30-4db1-8495-7d588f71e4af tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:16.440915 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-dd7500fc-ee30-4db1-8495-7d588f71e4af tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1352 microversion: 2.20 time: 0.101359 Jun 22 18:44:16.441817 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 415/789] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:16 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:44:17.460416 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7ac066a4-4880-4d3b-91d3-7c6bccd79263 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:17.460951 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7ac066a4-4880-4d3b-91d3-7c6bccd79263 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:17.467899 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ac066a4-4880-4d3b-91d3-7c6bccd79263 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:17.468347 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ac066a4-4880-4d3b-91d3-7c6bccd79263 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:17.469123 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ac066a4-4880-4d3b-91d3-7c6bccd79263 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:17.469550 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ac066a4-4880-4d3b-91d3-7c6bccd79263 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:17.706499 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7ac066a4-4880-4d3b-91d3-7c6bccd79263 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:17.714486 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7ac066a4-4880-4d3b-91d3-7c6bccd79263 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:17.716741 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7ac066a4-4880-4d3b-91d3-7c6bccd79263 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:17.717567 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7ac066a4-4880-4d3b-91d3-7c6bccd79263 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1408 microversion: 2.20 time: 0.261137 Jun 22 18:44:17.718123 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 375/790] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:17 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:44:18.018479 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-72e1487d-67c6-4d62-bf7b-0eaa7b3d8d79 req-4e4fb583-3050-4ef7-aaf1-edb97fa5bab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63daf967-ba4f-4773-92e1-ac70bc58330a", "tag": "d6614812-103b-4720-9cea-4cef6882458e"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:44:18.030232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-72e1487d-67c6-4d62-bf7b-0eaa7b3d8d79 req-4e4fb583-3050-4ef7-aaf1-edb97fa5bab2 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:18.030982 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-72e1487d-67c6-4d62-bf7b-0eaa7b3d8d79 req-4e4fb583-3050-4ef7-aaf1-edb97fa5bab2 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:18.051663 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-72e1487d-67c6-4d62-bf7b-0eaa7b3d8d79 req-4e4fb583-3050-4ef7-aaf1-edb97fa5bab2 service nova] Creating event network-changed:d6614812-103b-4720-9cea-4cef6882458e for instance 63daf967-ba4f-4773-92e1-ac70bc58330a on hv-cinder-81268 Jun 22 18:44:18.057987 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-72e1487d-67c6-4d62-bf7b-0eaa7b3d8d79 req-4e4fb583-3050-4ef7-aaf1-edb97fa5bab2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043204 Jun 22 18:44:18.059217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 416/791] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:44:18.734776 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-970010d8-27f1-41a2-81cf-a8ebeb1596e7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:18.735412 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-970010d8-27f1-41a2-81cf-a8ebeb1596e7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:18.742085 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-970010d8-27f1-41a2-81cf-a8ebeb1596e7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:18.742538 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-970010d8-27f1-41a2-81cf-a8ebeb1596e7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:18.743636 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-970010d8-27f1-41a2-81cf-a8ebeb1596e7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:18.744000 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-970010d8-27f1-41a2-81cf-a8ebeb1596e7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:18.950048 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-970010d8-27f1-41a2-81cf-a8ebeb1596e7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:18.958611 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-970010d8-27f1-41a2-81cf-a8ebeb1596e7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:18.960147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-970010d8-27f1-41a2-81cf-a8ebeb1596e7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:18.961252 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-970010d8-27f1-41a2-81cf-a8ebeb1596e7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1408 microversion: 2.20 time: 0.230559 Jun 22 18:44:18.961819 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 376/792] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:18 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:44:19.980591 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-fe9c9a08-5a48-47fc-9b72-87f3c5a6d448 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:19.981318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-fe9c9a08-5a48-47fc-9b72-87f3c5a6d448 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:19.987502 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fe9c9a08-5a48-47fc-9b72-87f3c5a6d448 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:19.987979 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fe9c9a08-5a48-47fc-9b72-87f3c5a6d448 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:19.988733 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fe9c9a08-5a48-47fc-9b72-87f3c5a6d448 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:19.989160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fe9c9a08-5a48-47fc-9b72-87f3c5a6d448 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:20.122254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fe9c9a08-5a48-47fc-9b72-87f3c5a6d448 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:20.130403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fe9c9a08-5a48-47fc-9b72-87f3c5a6d448 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:20.131894 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fe9c9a08-5a48-47fc-9b72-87f3c5a6d448 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:20.132966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-fe9c9a08-5a48-47fc-9b72-87f3c5a6d448 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1408 microversion: 2.20 time: 0.157175 Jun 22 18:44:20.133515 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 417/793] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:19 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:44:21.151446 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7038cff3-e321-484e-877a-f681f2106acb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:21.152010 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7038cff3-e321-484e-877a-f681f2106acb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:21.159455 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7038cff3-e321-484e-877a-f681f2106acb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:21.159936 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7038cff3-e321-484e-877a-f681f2106acb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:21.160703 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7038cff3-e321-484e-877a-f681f2106acb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:21.161141 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7038cff3-e321-484e-877a-f681f2106acb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:21.287211 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7038cff3-e321-484e-877a-f681f2106acb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:21.295153 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7038cff3-e321-484e-877a-f681f2106acb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:21.296704 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7038cff3-e321-484e-877a-f681f2106acb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:21.297799 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7038cff3-e321-484e-877a-f681f2106acb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1408 microversion: 2.20 time: 0.150388 Jun 22 18:44:21.298352 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 377/794] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:21 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:44:22.315754 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6b831700-75e8-4b75-8a36-8a4f69590fbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:22.316388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6b831700-75e8-4b75-8a36-8a4f69590fbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:22.322996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6b831700-75e8-4b75-8a36-8a4f69590fbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:22.323444 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6b831700-75e8-4b75-8a36-8a4f69590fbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:22.324231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6b831700-75e8-4b75-8a36-8a4f69590fbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:22.324738 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6b831700-75e8-4b75-8a36-8a4f69590fbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:22.452050 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6b831700-75e8-4b75-8a36-8a4f69590fbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:22.462702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6b831700-75e8-4b75-8a36-8a4f69590fbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:22.464226 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6b831700-75e8-4b75-8a36-8a4f69590fbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:22.466000 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6b831700-75e8-4b75-8a36-8a4f69590fbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1408 microversion: 2.20 time: 0.153596 Jun 22 18:44:22.466566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 418/795] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:22 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:44:23.484688 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-569a6008-493e-4aea-b7e9-fbe31a43892c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:23.485296 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-569a6008-493e-4aea-b7e9-fbe31a43892c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:23.491783 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-569a6008-493e-4aea-b7e9-fbe31a43892c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:23.492253 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-569a6008-493e-4aea-b7e9-fbe31a43892c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:23.493010 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-569a6008-493e-4aea-b7e9-fbe31a43892c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:23.493444 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-569a6008-493e-4aea-b7e9-fbe31a43892c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:23.629283 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-569a6008-493e-4aea-b7e9-fbe31a43892c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:23.637221 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-569a6008-493e-4aea-b7e9-fbe31a43892c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:23.638818 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-569a6008-493e-4aea-b7e9-fbe31a43892c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:23.639950 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-569a6008-493e-4aea-b7e9-fbe31a43892c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1408 microversion: 2.20 time: 0.159989 Jun 22 18:44:23.640517 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 378/796] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:23 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:44:24.658039 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-044a24e7-c55d-4493-8c62-b469b1a1b4d6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:24.658636 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-044a24e7-c55d-4493-8c62-b469b1a1b4d6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:24.664641 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-044a24e7-c55d-4493-8c62-b469b1a1b4d6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:24.665082 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-044a24e7-c55d-4493-8c62-b469b1a1b4d6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:24.665862 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-044a24e7-c55d-4493-8c62-b469b1a1b4d6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:24.666287 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-044a24e7-c55d-4493-8c62-b469b1a1b4d6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:24.808343 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-044a24e7-c55d-4493-8c62-b469b1a1b4d6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:24.816379 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-044a24e7-c55d-4493-8c62-b469b1a1b4d6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:24.817888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-044a24e7-c55d-4493-8c62-b469b1a1b4d6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:24.818980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-044a24e7-c55d-4493-8c62-b469b1a1b4d6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1408 microversion: 2.20 time: 0.164996 Jun 22 18:44:24.819537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 419/797] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:24 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:44:24.911035 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-763b64a6-2928-4fc3-8b38-5e73a603f17d req-520e4c26-f214-4409-a201-0ded6db4160c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63daf967-ba4f-4773-92e1-ac70bc58330a", "name": "network-vif-plugged", "status": "completed", "tag": "d6614812-103b-4720-9cea-4cef6882458e"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:44:24.920023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-763b64a6-2928-4fc3-8b38-5e73a603f17d req-520e4c26-f214-4409-a201-0ded6db4160c service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:24.920472 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-763b64a6-2928-4fc3-8b38-5e73a603f17d req-520e4c26-f214-4409-a201-0ded6db4160c service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:24.931707 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-763b64a6-2928-4fc3-8b38-5e73a603f17d req-520e4c26-f214-4409-a201-0ded6db4160c service nova] Creating event network-vif-plugged:d6614812-103b-4720-9cea-4cef6882458e for instance 63daf967-ba4f-4773-92e1-ac70bc58330a on hv-cinder-81268 Jun 22 18:44:24.937245 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-763b64a6-2928-4fc3-8b38-5e73a603f17d req-520e4c26-f214-4409-a201-0ded6db4160c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084698 Jun 22 18:44:24.937913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 379/798] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:44:25.837743 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7097287e-9929-4d44-badd-1cc783c67f29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:25.838348 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7097287e-9929-4d44-badd-1cc783c67f29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:25.840359 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:25.841019 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=6 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:25.848145 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7097287e-9929-4d44-badd-1cc783c67f29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:25.848596 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7097287e-9929-4d44-badd-1cc783c67f29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:25.849367 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7097287e-9929-4d44-badd-1cc783c67f29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:25.849802 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7097287e-9929-4d44-badd-1cc783c67f29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:25.975244 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7097287e-9929-4d44-badd-1cc783c67f29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:25.983572 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7097287e-9929-4d44-badd-1cc783c67f29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:25.985153 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7097287e-9929-4d44-badd-1cc783c67f29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:25.986241 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7097287e-9929-4d44-badd-1cc783c67f29 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1408 microversion: 2.20 time: 0.152393 Jun 22 18:44:25.986798 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 420/799] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:25 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:44:26.385538 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=6 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:26.390354 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-35369c48-04f4-4d3a-b49e-59264780ce4d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:26.390938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-35369c48-04f4-4d3a-b49e-59264780ce4d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:26.397562 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-35369c48-04f4-4d3a-b49e-59264780ce4d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:26.398008 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-35369c48-04f4-4d3a-b49e-59264780ce4d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:26.398772 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-35369c48-04f4-4d3a-b49e-59264780ce4d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:26.399208 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-35369c48-04f4-4d3a-b49e-59264780ce4d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:26.424173 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-35369c48-04f4-4d3a-b49e-59264780ce4d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Going to try to terminate instance {{(pid=129743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:44:26.507791 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-35369c48-04f4-4d3a-b49e-59264780ce4d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 204 len: 0 microversion: 2.1 time: 0.122782 Jun 22 18:44:26.508501 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 380/800] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:44:26 2022] DELETE /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:44:26.517034 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-70128476-4dd9-4bbf-a4c0-f1ea2043d533 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:26.517644 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-70128476-4dd9-4bbf-a4c0-f1ea2043d533 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:26.523626 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-70128476-4dd9-4bbf-a4c0-f1ea2043d533 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:26.524112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-70128476-4dd9-4bbf-a4c0-f1ea2043d533 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:26.524872 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-70128476-4dd9-4bbf-a4c0-f1ea2043d533 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:26.525303 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-70128476-4dd9-4bbf-a4c0-f1ea2043d533 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:26.660006 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-70128476-4dd9-4bbf-a4c0-f1ea2043d533 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:26.667446 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-70128476-4dd9-4bbf-a4c0-f1ea2043d533 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1579 microversion: 2.1 time: 0.154209 Jun 22 18:44:26.668026 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 421/801] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:26 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:27.005530 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4f9aabcc-63a2-4127-b101-61c2f9d10594 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:27.006211 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-4f9aabcc-63a2-4127-b101-61c2f9d10594 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:27.012324 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4f9aabcc-63a2-4127-b101-61c2f9d10594 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:27.012789 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4f9aabcc-63a2-4127-b101-61c2f9d10594 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:27.013541 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4f9aabcc-63a2-4127-b101-61c2f9d10594 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:27.013978 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4f9aabcc-63a2-4127-b101-61c2f9d10594 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:27.143012 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4f9aabcc-63a2-4127-b101-61c2f9d10594 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:27.151535 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4f9aabcc-63a2-4127-b101-61c2f9d10594 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:27.153314 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4f9aabcc-63a2-4127-b101-61c2f9d10594 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:27.154392 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4f9aabcc-63a2-4127-b101-61c2f9d10594 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1408 microversion: 2.20 time: 0.153400 Jun 22 18:44:27.154952 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 381/802] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:26 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:44:27.686037 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-52be8540-0522-4bbe-90e1-eb05ba9ec61a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:27.686635 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-52be8540-0522-4bbe-90e1-eb05ba9ec61a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:27.693117 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-52be8540-0522-4bbe-90e1-eb05ba9ec61a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:27.693560 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-52be8540-0522-4bbe-90e1-eb05ba9ec61a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:27.694319 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-52be8540-0522-4bbe-90e1-eb05ba9ec61a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:27.694747 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-52be8540-0522-4bbe-90e1-eb05ba9ec61a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:27.844770 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-52be8540-0522-4bbe-90e1-eb05ba9ec61a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:27.852434 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-52be8540-0522-4bbe-90e1-eb05ba9ec61a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1579 microversion: 2.1 time: 0.170313 Jun 22 18:44:27.852991 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 422/803] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:27 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:28.173069 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-680e128e-d75a-4522-991f-04171ff68060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:28.173677 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-680e128e-d75a-4522-991f-04171ff68060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:28.180558 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-680e128e-d75a-4522-991f-04171ff68060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:28.181008 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-680e128e-d75a-4522-991f-04171ff68060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:28.181767 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-680e128e-d75a-4522-991f-04171ff68060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:28.182202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-680e128e-d75a-4522-991f-04171ff68060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:28.314842 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-680e128e-d75a-4522-991f-04171ff68060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:28.322740 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-680e128e-d75a-4522-991f-04171ff68060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:28.324262 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-680e128e-d75a-4522-991f-04171ff68060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:28.325408 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-680e128e-d75a-4522-991f-04171ff68060 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1601 microversion: 2.20 time: 0.157040 Jun 22 18:44:28.325960 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 382/804] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:44:28 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:44:28.342902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8793f147-9c2a-4706-8fd9-a7e8248e656b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:28.343390 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8793f147-9c2a-4706-8fd9-a7e8248e656b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:28.349349 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8793f147-9c2a-4706-8fd9-a7e8248e656b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:28.349791 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8793f147-9c2a-4706-8fd9-a7e8248e656b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:28.350549 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8793f147-9c2a-4706-8fd9-a7e8248e656b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:28.350975 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8793f147-9c2a-4706-8fd9-a7e8248e656b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:28.430959 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8793f147-9c2a-4706-8fd9-a7e8248e656b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092403 Jun 22 18:44:28.431553 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 423/805] 10.222.0.18 () {60 vars in 1315 bytes} [Wed Jun 22 18:44:28 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:44:28.870376 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e9149e3d-97a8-476f-9a69-87108712c0f1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:28.872035 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e9149e3d-97a8-476f-9a69-87108712c0f1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:28.880799 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e9149e3d-97a8-476f-9a69-87108712c0f1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:28.881250 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e9149e3d-97a8-476f-9a69-87108712c0f1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:28.882026 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e9149e3d-97a8-476f-9a69-87108712c0f1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:28.882462 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e9149e3d-97a8-476f-9a69-87108712c0f1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:29.105003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e9149e3d-97a8-476f-9a69-87108712c0f1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:29.114513 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e9149e3d-97a8-476f-9a69-87108712c0f1 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1579 microversion: 2.1 time: 0.248218 Jun 22 18:44:29.115403 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 383/806] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:28 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1579 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:29.391005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-66b1cf66-0d56-4e3e-b0bb-085ed429292a req-c7a6505d-e2a2-43e2-ae2c-412c3c7158f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63daf967-ba4f-4773-92e1-ac70bc58330a", "tag": "d6614812-103b-4720-9cea-4cef6882458e"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:44:29.400399 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-66b1cf66-0d56-4e3e-b0bb-085ed429292a req-c7a6505d-e2a2-43e2-ae2c-412c3c7158f3 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:29.400928 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-66b1cf66-0d56-4e3e-b0bb-085ed429292a req-c7a6505d-e2a2-43e2-ae2c-412c3c7158f3 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:29.417884 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-66b1cf66-0d56-4e3e-b0bb-085ed429292a req-c7a6505d-e2a2-43e2-ae2c-412c3c7158f3 service nova] Creating event network-changed:d6614812-103b-4720-9cea-4cef6882458e for instance 63daf967-ba4f-4773-92e1-ac70bc58330a on hv-cinder-81268 Jun 22 18:44:29.425547 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-66b1cf66-0d56-4e3e-b0bb-085ed429292a req-c7a6505d-e2a2-43e2-ae2c-412c3c7158f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037047 Jun 22 18:44:29.426355 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 424/807] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:44:29.937071 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-2c49a99e-74d8-4873-85b8-1817080f10b0 req-9211d812-fa73-408b-8f64-48caab7cfec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2394525-6da9-4670-a17a-392e0c892204", "name": "network-vif-deleted", "tag": "8f63903e-463c-40f2-b578-98eaa2629dc7"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:44:29.957050 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-2c49a99e-74d8-4873-85b8-1817080f10b0 req-9211d812-fa73-408b-8f64-48caab7cfec6 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:29.958029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-2c49a99e-74d8-4873-85b8-1817080f10b0 req-9211d812-fa73-408b-8f64-48caab7cfec6 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:29.996767 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-2c49a99e-74d8-4873-85b8-1817080f10b0 req-9211d812-fa73-408b-8f64-48caab7cfec6 service nova] Creating event network-vif-deleted:8f63903e-463c-40f2-b578-98eaa2629dc7 for instance e2394525-6da9-4670-a17a-392e0c892204 on hv-cinder-81268 Jun 22 18:44:30.011202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-2c49a99e-74d8-4873-85b8-1817080f10b0 req-9211d812-fa73-408b-8f64-48caab7cfec6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074238 Jun 22 18:44:30.012425 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 384/808] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:44:30.133705 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c531f4c8-7117-451e-9068-9334a4319566 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:30.135123 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c531f4c8-7117-451e-9068-9334a4319566 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:30.142980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c531f4c8-7117-451e-9068-9334a4319566 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:30.143429 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c531f4c8-7117-451e-9068-9334a4319566 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:30.144241 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c531f4c8-7117-451e-9068-9334a4319566 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:30.144722 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c531f4c8-7117-451e-9068-9334a4319566 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:30.250502 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c531f4c8-7117-451e-9068-9334a4319566 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:30.260338 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c531f4c8-7117-451e-9068-9334a4319566 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 200 len: 1226 microversion: 2.1 time: 0.132107 Jun 22 18:44:30.270252 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 425/809] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:30 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 1226 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:31.278545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f29b7d6e-f579-4450-b189-961a6958263d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:31.279267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f29b7d6e-f579-4450-b189-961a6958263d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:31.285490 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f29b7d6e-f579-4450-b189-961a6958263d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:31.285932 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f29b7d6e-f579-4450-b189-961a6958263d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:31.286687 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f29b7d6e-f579-4450-b189-961a6958263d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:31.287120 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f29b7d6e-f579-4450-b189-961a6958263d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:31.300191 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-f29b7d6e-f579-4450-b189-961a6958263d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] HTTP exception thrown: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f29b7d6e-f579-4450-b189-961a6958263d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Request method failure captured: Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 HTTP/1.1 Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2IZ5TEn4BPJxHVhfhnxT81mrnbs2Rk9PmROtVEhJaPF5p-1m3EjFvkYS_fxfJuQdyZ4nj9IGq-NZb-_R5hx2v_cf0weelJidA7CIwKSfDi3xGV3LmeUhFpr87uFtSapDeG2jvPF3QjFh3W32Ju3irT1oTg4iPue-PHvhHF7gx7Sz5o Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 49c7f224d0374125ae22f576e8757f29 Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:44:31.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:44:31.303259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_49c7f224d0374125ae22f576e8757f29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:44:31.303259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:44:31.303259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 49c7f224d0374125ae22f576e8757f29 Jun 22 18:44:31.303259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:44:31.303259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-TestVolumeBootPattern-1174551677-project Jun 22 18:44:31.303259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:44:31.303259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:44:31.303259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 00cfbc965d934d6db28f41f8082eb5ef Jun 22 18:44:31.303259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-TestVolumeBootPattern-1174551677-project Jun 22 18:44:31.303259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:44:31.303259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:44:31.303259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': 'e2394525-6da9-4670-a17a-392e0c892204'} Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:44:31.304317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:44:31.305771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:44:31.307054 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f29b7d6e-f579-4450-b189-961a6958263d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Returning 404 to user: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:44:31.307054 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f29b7d6e-f579-4450-b189-961a6958263d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 404 len: 111 microversion: 2.1 time: 0.029297 Jun 22 18:44:31.307054 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 385/810] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:31 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:44:31.402128 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-345949600", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2107367893", "security_groups": [{"name": "tempest-secgroup-smoke-1212979075"}], "block_device_mapping_v2": [{"uuid": "b97d8223-42cf-4d1b-978b-73f81be546dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd7ae770-155c-4c8d-a4ad-fa877423fa7d"}]}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:44:31.519410 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.network.neutron [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] validate_networks() for [('fd7ae770-155c-4c8d-a4ad-fa877423fa7d', None, None, None, None, None)] {{(pid=129744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:44:31.883054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Flavor limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:44:31.883471 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Image limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:44:31.883971 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Flavor pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:44:31.884400 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Image pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:44:31.884803 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:44:31.894188 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:31.894564 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:31.895348 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:31.895771 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:31.912129 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Getting quotas for project 49c7f224d0374125ae22f576e8757f29. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:44:31.916295 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Getting quotas for user 00cfbc965d934d6db28f41f8082eb5ef and project 49c7f224d0374125ae22f576e8757f29. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:44:31.977957 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Going to run 1 instances... {{(pid=129744) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:44:31.980113 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b97d8223-42cf-4d1b-978b-73f81be546dc',volume_size=None,volume_type=None)] {{(pid=129744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:44:32.108834 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4ae64b37-00ef-4764-84c6-668ad0fdcc4e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712030 Jun 22 18:44:32.109463 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 426/811] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:44:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:44:32.119433 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e377f2c6-b621-4770-882e-dc65cfe9c165 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:32.120104 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e377f2c6-b621-4770-882e-dc65cfe9c165 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:32.175741 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e377f2c6-b621-4770-882e-dc65cfe9c165 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:32.182404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e377f2c6-b621-4770-882e-dc65cfe9c165 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1094 microversion: 2.1 time: 0.067053 Jun 22 18:44:32.182976 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 386/812] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:32 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:33.200807 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0ed6af28-e68a-4e77-892f-bdffcca14d50 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:33.201624 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0ed6af28-e68a-4e77-892f-bdffcca14d50 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:33.208488 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0ed6af28-e68a-4e77-892f-bdffcca14d50 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:33.208938 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0ed6af28-e68a-4e77-892f-bdffcca14d50 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:33.209886 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0ed6af28-e68a-4e77-892f-bdffcca14d50 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:33.210474 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0ed6af28-e68a-4e77-892f-bdffcca14d50 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:33.229191 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:33.275810 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0ed6af28-e68a-4e77-892f-bdffcca14d50 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:33.283622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0ed6af28-e68a-4e77-892f-bdffcca14d50 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1210 microversion: 2.1 time: 0.088758 Jun 22 18:44:33.284237 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 427/813] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:33 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:34.301758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6a8cbc5b-c8ad-41a4-a976-c1034a40ed2c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:34.303024 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6a8cbc5b-c8ad-41a4-a976-c1034a40ed2c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:34.310972 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6a8cbc5b-c8ad-41a4-a976-c1034a40ed2c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:34.311425 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6a8cbc5b-c8ad-41a4-a976-c1034a40ed2c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:34.312248 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6a8cbc5b-c8ad-41a4-a976-c1034a40ed2c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:34.312685 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6a8cbc5b-c8ad-41a4-a976-c1034a40ed2c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:34.536929 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6a8cbc5b-c8ad-41a4-a976-c1034a40ed2c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:34.541073 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:34.547349 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6a8cbc5b-c8ad-41a4-a976-c1034a40ed2c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1266 microversion: 2.1 time: 0.249338 Jun 22 18:44:34.547963 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 387/814] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:34 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:34.729910 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-2ae501bb-5af3-4067-8b3c-cd06cba682f5 req-b91cf87e-7d2a-4906-8f05-8b5d9ca1b7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37c799c-85a7-4ac9-ae8d-bd750ce354c8", "tag": "5a6f9e4b-2519-489b-b184-812b2e830a17"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:44:34.761241 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-2ae501bb-5af3-4067-8b3c-cd06cba682f5 req-b91cf87e-7d2a-4906-8f05-8b5d9ca1b7f4 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:34.761776 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-2ae501bb-5af3-4067-8b3c-cd06cba682f5 req-b91cf87e-7d2a-4906-8f05-8b5d9ca1b7f4 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:34.780189 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-2ae501bb-5af3-4067-8b3c-cd06cba682f5 req-b91cf87e-7d2a-4906-8f05-8b5d9ca1b7f4 service nova] Creating event network-changed:5a6f9e4b-2519-489b-b184-812b2e830a17 for instance f37c799c-85a7-4ac9-ae8d-bd750ce354c8 on hv-cinder-81268 Jun 22 18:44:34.785475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-2ae501bb-5af3-4067-8b3c-cd06cba682f5 req-b91cf87e-7d2a-4906-8f05-8b5d9ca1b7f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063983 Jun 22 18:44:34.786597 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 428/815] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:44:35.566252 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ce4aa56d-13ea-40a2-89e3-5627a8494912 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:35.566851 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ce4aa56d-13ea-40a2-89e3-5627a8494912 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:35.576161 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ce4aa56d-13ea-40a2-89e3-5627a8494912 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:35.576604 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ce4aa56d-13ea-40a2-89e3-5627a8494912 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:35.577358 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ce4aa56d-13ea-40a2-89e3-5627a8494912 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:35.577784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ce4aa56d-13ea-40a2-89e3-5627a8494912 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:35.709160 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ce4aa56d-13ea-40a2-89e3-5627a8494912 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:35.717007 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ce4aa56d-13ea-40a2-89e3-5627a8494912 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1266 microversion: 2.1 time: 0.155500 Jun 22 18:44:35.717570 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 388/816] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:35 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:44:36.734917 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-612739e3-a792-4d7f-901a-2035bc8ad7cc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:36.735661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-612739e3-a792-4d7f-901a-2035bc8ad7cc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:36.742045 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-612739e3-a792-4d7f-901a-2035bc8ad7cc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:36.742490 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-612739e3-a792-4d7f-901a-2035bc8ad7cc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:36.743256 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-612739e3-a792-4d7f-901a-2035bc8ad7cc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:36.743680 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-612739e3-a792-4d7f-901a-2035bc8ad7cc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:36.877307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-612739e3-a792-4d7f-901a-2035bc8ad7cc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:36.885246 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-612739e3-a792-4d7f-901a-2035bc8ad7cc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1266 microversion: 2.1 time: 0.156238 Jun 22 18:44:36.885805 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 429/817] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:36 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:37.901903 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f7fc289c-34fc-44b8-9137-39bacb276dac tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:37.902747 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f7fc289c-34fc-44b8-9137-39bacb276dac tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:37.904966 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:37.910159 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f7fc289c-34fc-44b8-9137-39bacb276dac tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:37.910598 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f7fc289c-34fc-44b8-9137-39bacb276dac tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:37.911347 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f7fc289c-34fc-44b8-9137-39bacb276dac tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:37.911774 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f7fc289c-34fc-44b8-9137-39bacb276dac tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:38.043689 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f7fc289c-34fc-44b8-9137-39bacb276dac tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:38.051086 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f7fc289c-34fc-44b8-9137-39bacb276dac tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1266 microversion: 2.1 time: 0.153043 Jun 22 18:44:38.051640 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 389/818] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:37 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:39.068049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a3e6fe90-b9f6-4ef2-b27f-ff5cf30921f4 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:39.068563 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a3e6fe90-b9f6-4ef2-b27f-ff5cf30921f4 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:39.070965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:39.076957 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a3e6fe90-b9f6-4ef2-b27f-ff5cf30921f4 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:39.077390 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a3e6fe90-b9f6-4ef2-b27f-ff5cf30921f4 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:39.078148 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a3e6fe90-b9f6-4ef2-b27f-ff5cf30921f4 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:39.078572 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a3e6fe90-b9f6-4ef2-b27f-ff5cf30921f4 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:39.208625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a3e6fe90-b9f6-4ef2-b27f-ff5cf30921f4 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:39.216174 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a3e6fe90-b9f6-4ef2-b27f-ff5cf30921f4 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1266 microversion: 2.1 time: 0.152073 Jun 22 18:44:39.216732 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 430/819] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:39 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:40.232832 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b62ab7e9-c408-4a80-8427-412479f65adc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:40.233435 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b62ab7e9-c408-4a80-8427-412479f65adc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:40.240009 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b62ab7e9-c408-4a80-8427-412479f65adc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:40.240448 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b62ab7e9-c408-4a80-8427-412479f65adc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:40.241202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b62ab7e9-c408-4a80-8427-412479f65adc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:40.241628 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b62ab7e9-c408-4a80-8427-412479f65adc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:40.373690 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b62ab7e9-c408-4a80-8427-412479f65adc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:40.381471 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b62ab7e9-c408-4a80-8427-412479f65adc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1266 microversion: 2.1 time: 0.152625 Jun 22 18:44:40.382038 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 390/820] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:40 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:41.398356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-61777623-b4c7-45d2-b9d9-51fe23f14d0d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:41.398989 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-61777623-b4c7-45d2-b9d9-51fe23f14d0d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:41.406086 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-61777623-b4c7-45d2-b9d9-51fe23f14d0d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:41.406526 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-61777623-b4c7-45d2-b9d9-51fe23f14d0d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:41.407304 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-61777623-b4c7-45d2-b9d9-51fe23f14d0d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:41.407728 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-61777623-b4c7-45d2-b9d9-51fe23f14d0d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:41.539396 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-61777623-b4c7-45d2-b9d9-51fe23f14d0d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:41.546907 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-61777623-b4c7-45d2-b9d9-51fe23f14d0d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1266 microversion: 2.1 time: 0.152352 Jun 22 18:44:41.547461 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 431/821] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:41 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:42.563663 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-db76e9ff-5be9-450d-a1df-3a633ce29c62 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:42.564311 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-db76e9ff-5be9-450d-a1df-3a633ce29c62 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:42.566617 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:42.571759 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-db76e9ff-5be9-450d-a1df-3a633ce29c62 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:42.572227 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-db76e9ff-5be9-450d-a1df-3a633ce29c62 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:42.572978 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-db76e9ff-5be9-450d-a1df-3a633ce29c62 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:42.573409 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-db76e9ff-5be9-450d-a1df-3a633ce29c62 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:42.703748 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-db76e9ff-5be9-450d-a1df-3a633ce29c62 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:42.711242 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-db76e9ff-5be9-450d-a1df-3a633ce29c62 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1266 microversion: 2.1 time: 0.151417 Jun 22 18:44:42.711801 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 391/822] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:42 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:43.728480 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-88a4608a-1de3-4595-a74c-903dd8eb17ba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:43.729072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-88a4608a-1de3-4595-a74c-903dd8eb17ba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:43.731671 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:43.732334 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=6 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:44:43.738457 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-88a4608a-1de3-4595-a74c-903dd8eb17ba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:43.738897 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-88a4608a-1de3-4595-a74c-903dd8eb17ba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:43.739649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-88a4608a-1de3-4595-a74c-903dd8eb17ba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:43.740099 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-88a4608a-1de3-4595-a74c-903dd8eb17ba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:43.869989 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-88a4608a-1de3-4595-a74c-903dd8eb17ba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:43.877941 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-88a4608a-1de3-4595-a74c-903dd8eb17ba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1266 microversion: 2.1 time: 0.153246 Jun 22 18:44:43.878688 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 432/823] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:43 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:44.894530 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-22e80259-d8bd-45b5-862c-35e3cdaba17e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:44.895141 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-22e80259-d8bd-45b5-862c-35e3cdaba17e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:44.901608 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-22e80259-d8bd-45b5-862c-35e3cdaba17e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:44.902592 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-22e80259-d8bd-45b5-862c-35e3cdaba17e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:44.903370 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-22e80259-d8bd-45b5-862c-35e3cdaba17e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:44.903813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-22e80259-d8bd-45b5-862c-35e3cdaba17e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:44.966914 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-c66ae38e-3fcb-4cc9-a838-bb3d1e288a1f req-8c017189-e506-4562-87cb-6fff52b577d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37c799c-85a7-4ac9-ae8d-bd750ce354c8", "name": "network-vif-plugged", "status": "completed", "tag": "5a6f9e4b-2519-489b-b184-812b2e830a17"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:44:44.977329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-c66ae38e-3fcb-4cc9-a838-bb3d1e288a1f req-8c017189-e506-4562-87cb-6fff52b577d7 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:44.978012 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-c66ae38e-3fcb-4cc9-a838-bb3d1e288a1f req-8c017189-e506-4562-87cb-6fff52b577d7 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:44.990528 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-c66ae38e-3fcb-4cc9-a838-bb3d1e288a1f req-8c017189-e506-4562-87cb-6fff52b577d7 service nova] Creating event network-vif-plugged:5a6f9e4b-2519-489b-b184-812b2e830a17 for instance f37c799c-85a7-4ac9-ae8d-bd750ce354c8 on hv-cinder-81268 Jun 22 18:44:44.996345 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-c66ae38e-3fcb-4cc9-a838-bb3d1e288a1f req-8c017189-e506-4562-87cb-6fff52b577d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032991 Jun 22 18:44:44.997292 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 433/824] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:44:45.052239 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-22e80259-d8bd-45b5-862c-35e3cdaba17e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:45.060455 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-22e80259-d8bd-45b5-862c-35e3cdaba17e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1266 microversion: 2.1 time: 0.169754 Jun 22 18:44:45.061016 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 392/825] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:44 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:46.078198 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-fafae9a4-3a1b-4ce7-9042-91a3b69aa436 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:46.078800 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-fafae9a4-3a1b-4ce7-9042-91a3b69aa436 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:46.085062 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fafae9a4-3a1b-4ce7-9042-91a3b69aa436 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:46.085516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fafae9a4-3a1b-4ce7-9042-91a3b69aa436 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:46.086282 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fafae9a4-3a1b-4ce7-9042-91a3b69aa436 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:46.086729 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fafae9a4-3a1b-4ce7-9042-91a3b69aa436 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:46.219044 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fafae9a4-3a1b-4ce7-9042-91a3b69aa436 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:46.226411 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-fafae9a4-3a1b-4ce7-9042-91a3b69aa436 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1266 microversion: 2.1 time: 0.153062 Jun 22 18:44:46.226965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 434/826] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:46 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:47.243405 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-33c2c5f2-0162-4b75-8b3c-dcf17dbbc91c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:47.243988 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-33c2c5f2-0162-4b75-8b3c-dcf17dbbc91c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:47.250993 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-33c2c5f2-0162-4b75-8b3c-dcf17dbbc91c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:47.251396 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-33c2c5f2-0162-4b75-8b3c-dcf17dbbc91c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:47.252207 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-33c2c5f2-0162-4b75-8b3c-dcf17dbbc91c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:47.252631 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-33c2c5f2-0162-4b75-8b3c-dcf17dbbc91c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:47.397748 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-33c2c5f2-0162-4b75-8b3c-dcf17dbbc91c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:47.405514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-33c2c5f2-0162-4b75-8b3c-dcf17dbbc91c tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1453 microversion: 2.1 time: 0.166150 Jun 22 18:44:47.406073 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 393/827] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:47 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:47.423984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ad288fb2-2f38-413f-8171-3186746f8e92 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:44:47.424595 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ad288fb2-2f38-413f-8171-3186746f8e92 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:44:47.431088 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ad288fb2-2f38-413f-8171-3186746f8e92 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:47.431540 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ad288fb2-2f38-413f-8171-3186746f8e92 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:47.432340 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ad288fb2-2f38-413f-8171-3186746f8e92 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:47.432781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ad288fb2-2f38-413f-8171-3186746f8e92 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:47.566585 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ad288fb2-2f38-413f-8171-3186746f8e92 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:44:47.574059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ad288fb2-2f38-413f-8171-3186746f8e92 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1453 microversion: 2.1 time: 0.153934 Jun 22 18:44:47.574616 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 435/828] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:44:47 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:44:49.361498 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-bc48479b-1592-472e-9730-477840a786f9 req-f9b839c6-9c22-4e62-9a1a-8c1f21ea9dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37c799c-85a7-4ac9-ae8d-bd750ce354c8", "tag": "5a6f9e4b-2519-489b-b184-812b2e830a17"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:44:49.370939 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-bc48479b-1592-472e-9730-477840a786f9 req-f9b839c6-9c22-4e62-9a1a-8c1f21ea9dad service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:44:49.371487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-bc48479b-1592-472e-9730-477840a786f9 req-f9b839c6-9c22-4e62-9a1a-8c1f21ea9dad service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:44:49.383713 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-bc48479b-1592-472e-9730-477840a786f9 req-f9b839c6-9c22-4e62-9a1a-8c1f21ea9dad service nova] Creating event network-changed:5a6f9e4b-2519-489b-b184-812b2e830a17 for instance f37c799c-85a7-4ac9-ae8d-bd750ce354c8 on hv-cinder-81268 Jun 22 18:44:49.390340 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-bc48479b-1592-472e-9730-477840a786f9 req-f9b839c6-9c22-4e62-9a1a-8c1f21ea9dad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032560 Jun 22 18:44:49.391300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 394/829] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:11.207927 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f2ca9d11-5291-46fb-aa7f-aa76cc37fec4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:11.208444 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f2ca9d11-5291-46fb-aa7f-aa76cc37fec4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:11.210700 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=11 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:11.211530 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=42 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:11.217582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f2ca9d11-5291-46fb-aa7f-aa76cc37fec4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:11.218027 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f2ca9d11-5291-46fb-aa7f-aa76cc37fec4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:11.218801 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f2ca9d11-5291-46fb-aa7f-aa76cc37fec4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:11.219233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f2ca9d11-5291-46fb-aa7f-aa76cc37fec4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:11.299335 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-f2ca9d11-5291-46fb-aa7f-aa76cc37fec4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lazy-loading 'services' on Instance uuid 398c2e47-c400-4fc9-9886-3bae472ef7ef {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:45:11.368363 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f2ca9d11-5291-46fb-aa7f-aa76cc37fec4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "DELETE /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-volume_attachments/c7169e0f-3ded-46ef-aba3-c8b6f61dd09e" status: 202 len: 0 microversion: 2.1 time: 0.164217 Jun 22 18:45:11.368938 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 436/830] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 18:45:11 2022] DELETE /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-volume_attachments/c7169e0f-3ded-46ef-aba3-c8b6f61dd09e => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:45:11.380047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-dae4dcee-93b5-4a22-86bb-acc35eee03cf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:11.381250 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-dae4dcee-93b5-4a22-86bb-acc35eee03cf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:11.383570 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=11 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:11.384298 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=38 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:11.391079 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dae4dcee-93b5-4a22-86bb-acc35eee03cf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:11.392281 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dae4dcee-93b5-4a22-86bb-acc35eee03cf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:11.392531 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dae4dcee-93b5-4a22-86bb-acc35eee03cf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:11.393081 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dae4dcee-93b5-4a22-86bb-acc35eee03cf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:11.424623 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-dae4dcee-93b5-4a22-86bb-acc35eee03cf tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050232 Jun 22 18:45:11.425179 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 395/831] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:45:11 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:12.439281 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e3b47b1b-eeb6-40e8-8fc9-f31f054e640a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:12.440293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e3b47b1b-eeb6-40e8-8fc9-f31f054e640a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:12.446534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e3b47b1b-eeb6-40e8-8fc9-f31f054e640a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:12.446972 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e3b47b1b-eeb6-40e8-8fc9-f31f054e640a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:12.447724 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e3b47b1b-eeb6-40e8-8fc9-f31f054e640a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:12.448181 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e3b47b1b-eeb6-40e8-8fc9-f31f054e640a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:12.477490 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e3b47b1b-eeb6-40e8-8fc9-f31f054e640a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043116 Jun 22 18:45:12.478030 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 437/832] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:45:12 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 18:45:12.548544 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ca93697f-ceb3-449b-a2c7-a3e4cdb46afd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:12.549057 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ca93697f-ceb3-449b-a2c7-a3e4cdb46afd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:12.555781 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca93697f-ceb3-449b-a2c7-a3e4cdb46afd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:12.556692 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca93697f-ceb3-449b-a2c7-a3e4cdb46afd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:12.557511 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca93697f-ceb3-449b-a2c7-a3e4cdb46afd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:12.557950 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ca93697f-ceb3-449b-a2c7-a3e4cdb46afd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:12.585417 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ca93697f-ceb3-449b-a2c7-a3e4cdb46afd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Going to try to terminate instance {{(pid=129743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:45:12.659355 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ca93697f-ceb3-449b-a2c7-a3e4cdb46afd tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "DELETE /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 204 len: 0 microversion: 2.1 time: 0.114128 Jun 22 18:45:12.660003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 396/833] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:45:12 2022] DELETE /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 18:45:12.669337 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-716a75a6-619d-4d82-857a-8644fe2abf6c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:12.669940 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-716a75a6-619d-4d82-857a-8644fe2abf6c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:12.676005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-716a75a6-619d-4d82-857a-8644fe2abf6c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:12.676459 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-716a75a6-619d-4d82-857a-8644fe2abf6c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:12.677223 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-716a75a6-619d-4d82-857a-8644fe2abf6c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:12.677659 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-716a75a6-619d-4d82-857a-8644fe2abf6c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:12.811794 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-716a75a6-619d-4d82-857a-8644fe2abf6c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:12.819255 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-716a75a6-619d-4d82-857a-8644fe2abf6c tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1689 microversion: 2.1 time: 0.154652 Jun 22 18:45:12.819812 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 438/834] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:12 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:13.147501 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ccc614f0-313b-4094-8a28-3485b651f5c7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:13.148580 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ccc614f0-313b-4094-8a28-3485b651f5c7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:13.155279 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ccc614f0-313b-4094-8a28-3485b651f5c7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:13.155716 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ccc614f0-313b-4094-8a28-3485b651f5c7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:13.156490 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ccc614f0-313b-4094-8a28-3485b651f5c7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:13.156913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ccc614f0-313b-4094-8a28-3485b651f5c7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:13.184751 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ccc614f0-313b-4094-8a28-3485b651f5c7 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041804 Jun 22 18:45:13.185292 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 397/835] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:45:13 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 18:45:13.241473 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0a061134-2b8c-4695-a62a-453535abeca4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:13.241958 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0a061134-2b8c-4695-a62a-453535abeca4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:13.248054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0a061134-2b8c-4695-a62a-453535abeca4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:13.248507 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0a061134-2b8c-4695-a62a-453535abeca4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:13.249244 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0a061134-2b8c-4695-a62a-453535abeca4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:13.249669 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0a061134-2b8c-4695-a62a-453535abeca4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:13.274430 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0a061134-2b8c-4695-a62a-453535abeca4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Going to try to terminate instance {{(pid=129744) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:45:13.348515 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0a061134-2b8c-4695-a62a-453535abeca4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 204 len: 0 microversion: 2.1 time: 0.110538 Jun 22 18:45:13.348976 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 439/836] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:45:13 2022] DELETE /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:45:13.357598 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f4ae3846-ffbe-4ac0-b3bf-ed9962476375 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:13.358262 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f4ae3846-ffbe-4ac0-b3bf-ed9962476375 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:13.364233 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f4ae3846-ffbe-4ac0-b3bf-ed9962476375 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:13.364672 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f4ae3846-ffbe-4ac0-b3bf-ed9962476375 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:13.365459 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f4ae3846-ffbe-4ac0-b3bf-ed9962476375 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:13.365883 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f4ae3846-ffbe-4ac0-b3bf-ed9962476375 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:13.495230 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f4ae3846-ffbe-4ac0-b3bf-ed9962476375 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:13.503381 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f4ae3846-ffbe-4ac0-b3bf-ed9962476375 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1672 microversion: 2.1 time: 0.149908 Jun 22 18:45:13.503972 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 398/837] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:13 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:13.836921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-21019424-17e6-444b-81b2-b14487d4b007 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:13.837605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-21019424-17e6-444b-81b2-b14487d4b007 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:13.845025 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-21019424-17e6-444b-81b2-b14487d4b007 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:13.845444 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-21019424-17e6-444b-81b2-b14487d4b007 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:13.846288 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-21019424-17e6-444b-81b2-b14487d4b007 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:13.846814 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-21019424-17e6-444b-81b2-b14487d4b007 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:13.972853 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-21019424-17e6-444b-81b2-b14487d4b007 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:13.980780 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-21019424-17e6-444b-81b2-b14487d4b007 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1689 microversion: 2.1 time: 0.147528 Jun 22 18:45:13.981347 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 440/838] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:13 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:14.520962 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-10b19c5b-8ac4-480a-936a-3282cc857d07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:14.521559 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-10b19c5b-8ac4-480a-936a-3282cc857d07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:14.528269 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-10b19c5b-8ac4-480a-936a-3282cc857d07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:14.528708 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-10b19c5b-8ac4-480a-936a-3282cc857d07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:14.529458 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-10b19c5b-8ac4-480a-936a-3282cc857d07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:14.529884 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-10b19c5b-8ac4-480a-936a-3282cc857d07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:14.665645 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-10b19c5b-8ac4-480a-936a-3282cc857d07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:14.673948 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-10b19c5b-8ac4-480a-936a-3282cc857d07 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1672 microversion: 2.1 time: 0.156811 Jun 22 18:45:14.674503 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 399/839] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:14 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:14.998194 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6e763414-ab10-420d-8d45-5f9b9fd8771f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:14.998732 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6e763414-ab10-420d-8d45-5f9b9fd8771f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:15.005456 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6e763414-ab10-420d-8d45-5f9b9fd8771f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:15.005901 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6e763414-ab10-420d-8d45-5f9b9fd8771f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:15.006700 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6e763414-ab10-420d-8d45-5f9b9fd8771f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:15.007165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6e763414-ab10-420d-8d45-5f9b9fd8771f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:15.135990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6e763414-ab10-420d-8d45-5f9b9fd8771f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:15.143436 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6e763414-ab10-420d-8d45-5f9b9fd8771f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1689 microversion: 2.1 time: 0.149666 Jun 22 18:45:15.144023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 441/840] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:14 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:15.692148 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7f3d7de3-669a-4da7-834b-e316eedb8487 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:15.692810 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7f3d7de3-669a-4da7-834b-e316eedb8487 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:15.700361 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7f3d7de3-669a-4da7-834b-e316eedb8487 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:15.700858 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7f3d7de3-669a-4da7-834b-e316eedb8487 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:15.701651 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7f3d7de3-669a-4da7-834b-e316eedb8487 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:15.702078 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7f3d7de3-669a-4da7-834b-e316eedb8487 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:15.843564 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7f3d7de3-669a-4da7-834b-e316eedb8487 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:15.851089 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7f3d7de3-669a-4da7-834b-e316eedb8487 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1672 microversion: 2.1 time: 0.162873 Jun 22 18:45:15.851652 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 400/841] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:15 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:16.160677 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-94fe5e9c-8b47-47b5-b629-fd14d9ae3561 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:16.161259 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-94fe5e9c-8b47-47b5-b629-fd14d9ae3561 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:16.167811 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-94fe5e9c-8b47-47b5-b629-fd14d9ae3561 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:16.168283 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-94fe5e9c-8b47-47b5-b629-fd14d9ae3561 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:16.169036 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-94fe5e9c-8b47-47b5-b629-fd14d9ae3561 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:16.169465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-94fe5e9c-8b47-47b5-b629-fd14d9ae3561 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:16.294909 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-94fe5e9c-8b47-47b5-b629-fd14d9ae3561 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:16.302281 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-94fe5e9c-8b47-47b5-b629-fd14d9ae3561 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1689 microversion: 2.1 time: 0.145440 Jun 22 18:45:16.302827 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 442/842] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:16 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1689 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:16.869365 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f1082bd1-308c-481b-84f0-066beaab4443 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:16.871420 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f1082bd1-308c-481b-84f0-066beaab4443 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:16.879312 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f1082bd1-308c-481b-84f0-066beaab4443 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:16.879758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f1082bd1-308c-481b-84f0-066beaab4443 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:16.880603 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f1082bd1-308c-481b-84f0-066beaab4443 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:16.881033 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f1082bd1-308c-481b-84f0-066beaab4443 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:17.114815 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f1082bd1-308c-481b-84f0-066beaab4443 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:17.124190 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f1082bd1-308c-481b-84f0-066beaab4443 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1672 microversion: 2.1 time: 0.259514 Jun 22 18:45:17.124763 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 401/843] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:16 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1672 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:17.318848 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-bd6bdef6-8c2e-43e4-94bc-7c7bc65d46a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:17.319422 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-bd6bdef6-8c2e-43e4-94bc-7c7bc65d46a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:17.326664 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd6bdef6-8c2e-43e4-94bc-7c7bc65d46a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:17.327118 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd6bdef6-8c2e-43e4-94bc-7c7bc65d46a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:17.327918 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd6bdef6-8c2e-43e4-94bc-7c7bc65d46a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:17.328379 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd6bdef6-8c2e-43e4-94bc-7c7bc65d46a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:17.464979 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bd6bdef6-8c2e-43e4-94bc-7c7bc65d46a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:17.472420 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-bd6bdef6-8c2e-43e4-94bc-7c7bc65d46a4 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1689 microversion: 2.1 time: 0.157841 Jun 22 18:45:17.472982 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 443/844] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:17 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:18.141724 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b677c5cf-8499-4820-960b-c63649b4cc42 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:18.142288 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b677c5cf-8499-4820-960b-c63649b4cc42 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:18.149313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b677c5cf-8499-4820-960b-c63649b4cc42 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:18.149709 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b677c5cf-8499-4820-960b-c63649b4cc42 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:18.150454 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b677c5cf-8499-4820-960b-c63649b4cc42 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:18.150885 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b677c5cf-8499-4820-960b-c63649b4cc42 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:18.392535 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-06393c3f-1018-45ff-a55e-103200b5034f req-a6d55dfd-d84e-4ecd-80d3-e84fe9dcf2ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398c2e47-c400-4fc9-9886-3bae472ef7ef", "name": "network-vif-deleted", "tag": "82a54d97-7875-47e7-82fc-49324718c1f0"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:18.409451 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-06393c3f-1018-45ff-a55e-103200b5034f req-a6d55dfd-d84e-4ecd-80d3-e84fe9dcf2ad service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:18.410324 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-06393c3f-1018-45ff-a55e-103200b5034f req-a6d55dfd-d84e-4ecd-80d3-e84fe9dcf2ad service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:18.427244 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-06393c3f-1018-45ff-a55e-103200b5034f req-a6d55dfd-d84e-4ecd-80d3-e84fe9dcf2ad service nova] Creating event network-vif-deleted:82a54d97-7875-47e7-82fc-49324718c1f0 for instance 398c2e47-c400-4fc9-9886-3bae472ef7ef on hv-cinder-81268 Jun 22 18:45:18.433158 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-06393c3f-1018-45ff-a55e-103200b5034f req-a6d55dfd-d84e-4ecd-80d3-e84fe9dcf2ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045095 Jun 22 18:45:18.434051 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 444/845] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:18.474442 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b677c5cf-8499-4820-960b-c63649b4cc42 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:18.492853 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b677c5cf-8499-4820-960b-c63649b4cc42 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 200 len: 1672 microversion: 2.1 time: 0.354875 Jun 22 18:45:18.503902 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 402/846] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:18 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 1672 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:18.506012 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-18932ee0-e855-41b6-959a-3182cd824040 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:18.506981 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-18932ee0-e855-41b6-959a-3182cd824040 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:18.514969 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-18932ee0-e855-41b6-959a-3182cd824040 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:18.516068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-18932ee0-e855-41b6-959a-3182cd824040 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:18.517036 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-18932ee0-e855-41b6-959a-3182cd824040 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:18.517894 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-18932ee0-e855-41b6-959a-3182cd824040 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:18.580447 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-18932ee0-e855-41b6-959a-3182cd824040 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:18.580890 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-18932ee0-e855-41b6-959a-3182cd824040 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:18.581527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-18932ee0-e855-41b6-959a-3182cd824040 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lazy-loading 'fault' on Instance uuid 398c2e47-c400-4fc9-9886-3bae472ef7ef {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:45:18.634259 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-18932ee0-e855-41b6-959a-3182cd824040 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:18.644552 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-18932ee0-e855-41b6-959a-3182cd824040 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 200 len: 1335 microversion: 2.1 time: 0.156588 Jun 22 18:45:18.645130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 445/847] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:18 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 1335 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:19.510651 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a5c88caa-a0ad-4fd2-9571-8622c1ea50b8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:19.512599 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a5c88caa-a0ad-4fd2-9571-8622c1ea50b8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:19.519362 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a5c88caa-a0ad-4fd2-9571-8622c1ea50b8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:19.519803 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a5c88caa-a0ad-4fd2-9571-8622c1ea50b8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:19.520794 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a5c88caa-a0ad-4fd2-9571-8622c1ea50b8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:19.521226 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a5c88caa-a0ad-4fd2-9571-8622c1ea50b8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:19.536027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-a5c88caa-a0ad-4fd2-9571-8622c1ea50b8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] HTTP exception thrown: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a5c88caa-a0ad-4fd2-9571-8622c1ea50b8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Request method failure captured: Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc HTTP/1.1 Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GMT04a9HhiLbZ6CXtENETzHuBCWqYHm_PV01cxItErRqYF8vGOHB5yij8nrcjja8JbYnm97hnEwO-hp8XT_WEZUO7L0agarh-ZJASLsNdnMc9OQNK2jVrm4G8zrtQJT5GOcuHDs7f7oL_abRoO5IY9-sxUnFUme4q1kwnC-oyXxdc Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: b91b10b850024bae8e0d76aa9628224d Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:45:19.537828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:45:19.539468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b91b10b850024bae8e0d76aa9628224d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:45:19.539468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:45:19.539468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: b91b10b850024bae8e0d76aa9628224d Jun 22 18:45:19.539468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:45:19.539468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeTestJSON-142553001-project Jun 22 18:45:19.539468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:45:19.539468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:45:19.539468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: d32582f1a1994e3b9c05f56185d0079d Jun 22 18:45:19.539468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeTestJSON-142553001-project Jun 22 18:45:19.539468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:45:19.539468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:45:19.539468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '2a9799ba-7e8d-4145-b942-752d45813cfc'} Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:45:19.540545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:45:19.541973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:19.543377 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a5c88caa-a0ad-4fd2-9571-8622c1ea50b8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Returning 404 to user: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:45:19.543377 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a5c88caa-a0ad-4fd2-9571-8622c1ea50b8 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 404 len: 111 microversion: 2.1 time: 0.032522 Jun 22 18:45:19.543889 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 403/848] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:19 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:45:19.548913 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d2277b86-4c8d-462f-85f4-a6c56fef021d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '.version_select at 0x7fd75549e430>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:19.568419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d2277b86-4c8d-462f-85f4-a6c56fef021d tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-156826004" status: 202 len: 0 microversion: 2.1 time: 0.022893 Jun 22 18:45:19.569436 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 446/849] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jun 22 18:45:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-156826004 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:45:19.664724 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-50db5fca-b558-4e7f-8dae-39dae340594a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:19.670089 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-50db5fca-b558-4e7f-8dae-39dae340594a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 398c2e47-c400-4fc9-9886-3bae472ef7ef] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:19.676652 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-50db5fca-b558-4e7f-8dae-39dae340594a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:19.677104 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-50db5fca-b558-4e7f-8dae-39dae340594a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:19.677914 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-50db5fca-b558-4e7f-8dae-39dae340594a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:19.678552 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-50db5fca-b558-4e7f-8dae-39dae340594a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:19.701275 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-50db5fca-b558-4e7f-8dae-39dae340594a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] HTTP exception thrown: Instance 398c2e47-c400-4fc9-9886-3bae472ef7ef could not be found. Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-50db5fca-b558-4e7f-8dae-39dae340594a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Request method failure captured: Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef HTTP/1.1 Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GNWSRtAX4FCk4LKPpi2_4oWKg9AzU00FZZox6EKvRPv3yOEoSkqMJkrp8JcBA7WmQt8XgNCQItYQFcBY7IUMtSbG8XqaBpHjESKBr-Rg576Nkmc8jTKetJOWTVZ3d5ny-d34E1fPriTEmE5WqlnluiEkCCfs9w6t1LdNoFGljh4Gc Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: d866c4a659e74e42a3c37050eae82229 Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:45:19.703264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:45:19.704796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d866c4a659e74e42a3c37050eae82229", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:45:19.704796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:45:19.704796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: d866c4a659e74e42a3c37050eae82229 Jun 22 18:45:19.704796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:45:19.704796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-ServerRescueNegativeTestJSON-1877302870-project Jun 22 18:45:19.704796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:45:19.704796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:45:19.704796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 94d5713dc97f442f916b22d925c35042 Jun 22 18:45:19.704796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1877302870-project Jun 22 18:45:19.704796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:45:19.704796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 398c2e47-c400-4fc9-9886-3bae472ef7ef could not be found. Jun 22 18:45:19.704796 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '398c2e47-c400-4fc9-9886-3bae472ef7ef'} Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 398c2e47-c400-4fc9-9886-3bae472ef7ef could not be found. Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:45:19.705634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 398c2e47-c400-4fc9-9886-3bae472ef7ef could not be found. Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 398c2e47-c400-4fc9-9886-3bae472ef7ef could not be found. Jun 22 18:45:19.706786 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:19.707889 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-50db5fca-b558-4e7f-8dae-39dae340594a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Returning 404 to user: Instance 398c2e47-c400-4fc9-9886-3bae472ef7ef could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:45:19.707889 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-50db5fca-b558-4e7f-8dae-39dae340594a tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef" status: 404 len: 111 microversion: 2.1 time: 0.046222 Jun 22 18:45:19.707889 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 404/850] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:19 2022] GET /compute/v2.1/servers/398c2e47-c400-4fc9-9886-3bae472ef7ef => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:45:19.714893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b5ae040b-2d5a-4bd6-90c4-4fac60f5f071 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '.version_select at 0x7fd7554c11f0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:19.744311 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b5ae040b-2d5a-4bd6-90c4-4fac60f5f071 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949485267" status: 202 len: 0 microversion: 2.1 time: 0.033854 Jun 22 18:45:19.744939 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 447/851] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jun 22 18:45:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949485267 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:45:20.304784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-fc0eef34-6e90-4d84-9a96-f92dbfe42142 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Action: 'create', calling method: .version_select at 0x7fd7553dfe50>, body: {"keypair": {"name": "tempest-keypair-786220574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4gyma7hHlDJkIP/Ow+dC4zsRhVU9GsZYFE1Zw71pvvyYmYEfxvGOmLodJMGedh9mpuhumOokFGJYhAWLPOTvBtm00Cvb7BTivh5ADYKcVSH2PzmFfM0zuuf80DxrLo5A=="}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:20.319997 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-fc0eef34-6e90-4d84-9a96-f92dbfe42142 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Getting quotas for project b91b10b850024bae8e0d76aa9628224d. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:45:20.324346 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-fc0eef34-6e90-4d84-9a96-f92dbfe42142 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Getting quotas for user d32582f1a1994e3b9c05f56185d0079d and project b91b10b850024bae8e0d76aa9628224d. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:45:20.348075 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-fc0eef34-6e90-4d84-9a96-f92dbfe42142 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053424 Jun 22 18:45:20.348835 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 405/852] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 18:45:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:20.491097 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-41490f59-2902-4edb-a771-f249a5073716 req-5bb10686-cd84-4127-9c19-3691dd2ab412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a9799ba-7e8d-4145-b942-752d45813cfc", "name": "network-vif-deleted", "tag": "ff5e1751-3636-44a9-8f6a-879586f4b3a2"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:20.509089 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-41490f59-2902-4edb-a771-f249a5073716 req-5bb10686-cd84-4127-9c19-3691dd2ab412 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:20.509615 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-41490f59-2902-4edb-a771-f249a5073716 req-5bb10686-cd84-4127-9c19-3691dd2ab412 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:20.522294 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-41490f59-2902-4edb-a771-f249a5073716 req-5bb10686-cd84-4127-9c19-3691dd2ab412 service nova] Creating event network-vif-deleted:ff5e1751-3636-44a9-8f6a-879586f4b3a2 for instance 2a9799ba-7e8d-4145-b942-752d45813cfc on hv-cinder-81268 Jun 22 18:45:20.530294 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-41490f59-2902-4edb-a771-f249a5073716 req-5bb10686-cd84-4127-9c19-3691dd2ab412 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043205 Jun 22 18:45:20.530896 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 448/853] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:21.554981 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-735506678", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2646f914-6f7d-47fd-80ab-e013c343a932"}], "security_groups": [{"name": "tempest-securitygroup--447011466"}], "key_name": "tempest-keypair-786220574", "user_data": "}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:21.657956 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.network.neutron [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] validate_networks() for [('2646f914-6f7d-47fd-80ab-e013c343a932', None, None, None, None, None)] {{(pid=129743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:45:22.052763 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Flavor limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:45:22.053185 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Image limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:45:22.053660 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Flavor pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:45:22.054073 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Image pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:45:22.054483 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:45:22.063417 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:22.063966 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:22.064785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:22.065222 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:22.083755 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Getting quotas for project b91b10b850024bae8e0d76aa9628224d. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:45:22.088441 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Getting quotas for user d32582f1a1994e3b9c05f56185d0079d and project b91b10b850024bae8e0d76aa9628224d. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:45:22.103283 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Going to run 1 instances... {{(pid=129743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:45:22.105946 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:45:22.159603 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-02a49e00-cc46-42ba-84e4-69dae6cdec71 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.609366 Jun 22 18:45:22.160280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 406/854] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:45:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:45:22.171306 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-aaeffb36-2471-43b8-b24a-6f3012b6d3e2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:22.172013 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-aaeffb36-2471-43b8-b24a-6f3012b6d3e2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:22.229002 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-aaeffb36-2471-43b8-b24a-6f3012b6d3e2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:22.236901 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-aaeffb36-2471-43b8-b24a-6f3012b6d3e2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1236 microversion: 2.1 time: 0.070316 Jun 22 18:45:22.237436 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 449/855] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:22 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:22.868374 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e769ceaf-9fcc-419e-941b-4afcc42e135d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:22.868872 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e769ceaf-9fcc-419e-941b-4afcc42e135d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:22.876844 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e769ceaf-9fcc-419e-941b-4afcc42e135d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:22.877290 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e769ceaf-9fcc-419e-941b-4afcc42e135d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:22.878306 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e769ceaf-9fcc-419e-941b-4afcc42e135d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:22.878737 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e769ceaf-9fcc-419e-941b-4afcc42e135d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:22.903702 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e769ceaf-9fcc-419e-941b-4afcc42e135d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Going to try to terminate instance {{(pid=129743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:45:22.976791 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e769ceaf-9fcc-419e-941b-4afcc42e135d tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 204 len: 0 microversion: 2.1 time: 0.112548 Jun 22 18:45:22.977351 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 407/856] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:45:22 2022] DELETE /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:45:22.985697 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-91b56073-0ba7-48e8-aaa6-138de689f8b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:22.986324 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-91b56073-0ba7-48e8-aaa6-138de689f8b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:22.993470 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-91b56073-0ba7-48e8-aaa6-138de689f8b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:22.993924 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-91b56073-0ba7-48e8-aaa6-138de689f8b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:22.994692 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-91b56073-0ba7-48e8-aaa6-138de689f8b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:22.995701 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-91b56073-0ba7-48e8-aaa6-138de689f8b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:23.132329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-91b56073-0ba7-48e8-aaa6-138de689f8b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:23.141155 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-91b56073-0ba7-48e8-aaa6-138de689f8b5 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1507 microversion: 2.1 time: 0.159208 Jun 22 18:45:23.141724 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 450/857] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:22 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:23.254729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c0a2c3cf-4774-4d57-864c-834ea9cdc8ef tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:23.255632 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c0a2c3cf-4774-4d57-864c-834ea9cdc8ef tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:23.262033 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c0a2c3cf-4774-4d57-864c-834ea9cdc8ef tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:23.262593 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c0a2c3cf-4774-4d57-864c-834ea9cdc8ef tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:23.263615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c0a2c3cf-4774-4d57-864c-834ea9cdc8ef tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:23.264158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c0a2c3cf-4774-4d57-864c-834ea9cdc8ef tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:23.333256 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c0a2c3cf-4774-4d57-864c-834ea9cdc8ef tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:23.340788 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c0a2c3cf-4774-4d57-864c-834ea9cdc8ef tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1294 microversion: 2.1 time: 0.090660 Jun 22 18:45:23.341369 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 408/858] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:23 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:24.158487 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f10c0405-323c-4564-8d19-a4d4f3c06702 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:24.159288 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f10c0405-323c-4564-8d19-a4d4f3c06702 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:24.165934 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f10c0405-323c-4564-8d19-a4d4f3c06702 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:24.166473 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f10c0405-323c-4564-8d19-a4d4f3c06702 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:24.167892 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f10c0405-323c-4564-8d19-a4d4f3c06702 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:24.168392 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f10c0405-323c-4564-8d19-a4d4f3c06702 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:24.297156 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f10c0405-323c-4564-8d19-a4d4f3c06702 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:24.304840 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f10c0405-323c-4564-8d19-a4d4f3c06702 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 200 len: 1507 microversion: 2.1 time: 0.150209 Jun 22 18:45:24.305462 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 451/859] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:24 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:24.358695 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f95c8669-7472-48ec-8f3b-3164d7904498 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:24.359419 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f95c8669-7472-48ec-8f3b-3164d7904498 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:24.366082 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f95c8669-7472-48ec-8f3b-3164d7904498 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:24.366531 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f95c8669-7472-48ec-8f3b-3164d7904498 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:24.367298 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f95c8669-7472-48ec-8f3b-3164d7904498 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:24.367726 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f95c8669-7472-48ec-8f3b-3164d7904498 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:24.696373 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f95c8669-7472-48ec-8f3b-3164d7904498 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:24.706186 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f95c8669-7472-48ec-8f3b-3164d7904498 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1361 microversion: 2.1 time: 0.352155 Jun 22 18:45:24.707105 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 409/860] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:24 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:24.741460 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-b0ddbaf5-7096-41b1-87fd-6848c9ba25d9 req-fa4fc13a-e3f5-4d99-a5dc-0ea16f43b6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5414be47-8679-4c15-9b75-4da9d4d9ac1b", "name": "network-vif-deleted", "tag": "398742f5-c1a9-424d-9b37-ae5ab7336f30"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:24.749537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-b0ddbaf5-7096-41b1-87fd-6848c9ba25d9 req-fa4fc13a-e3f5-4d99-a5dc-0ea16f43b6e2 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:24.751402 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-b0ddbaf5-7096-41b1-87fd-6848c9ba25d9 req-fa4fc13a-e3f5-4d99-a5dc-0ea16f43b6e2 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:24.764926 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-b0ddbaf5-7096-41b1-87fd-6848c9ba25d9 req-fa4fc13a-e3f5-4d99-a5dc-0ea16f43b6e2 service nova] Creating event network-vif-deleted:398742f5-c1a9-424d-9b37-ae5ab7336f30 for instance 5414be47-8679-4c15-9b75-4da9d4d9ac1b on hv-cinder-81268 Jun 22 18:45:24.770076 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-b0ddbaf5-7096-41b1-87fd-6848c9ba25d9 req-fa4fc13a-e3f5-4d99-a5dc-0ea16f43b6e2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032541 Jun 22 18:45:24.771346 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 452/861] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:25.324988 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-fe1c43ae-9aff-4e50-a69e-41e5367280c6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:25.325524 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-fe1c43ae-9aff-4e50-a69e-41e5367280c6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 5414be47-8679-4c15-9b75-4da9d4d9ac1b] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:25.331751 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fe1c43ae-9aff-4e50-a69e-41e5367280c6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:25.332238 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fe1c43ae-9aff-4e50-a69e-41e5367280c6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:25.333274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fe1c43ae-9aff-4e50-a69e-41e5367280c6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:25.333715 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fe1c43ae-9aff-4e50-a69e-41e5367280c6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:25.350430 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-fe1c43ae-9aff-4e50-a69e-41e5367280c6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] HTTP exception thrown: Instance 5414be47-8679-4c15-9b75-4da9d4d9ac1b could not be found. Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-fe1c43ae-9aff-4e50-a69e-41e5367280c6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Request method failure captured: Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b HTTP/1.1 Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GNWSRtAX4FCk4LKPpi2_4oWKg9AzU00FZZox6EKvRPv3yOEoSkqMJkrp8JcBA7WmQt8XgNCQItYQFcBY7IUMtSbG8XqaBpHjESKBr-Rg576Nkmc8jTKetJOWTVZ3d5ny-d34E1fPriTEmE5WqlnluiEkCCfs9w6t1LdNoFGljh4Gc Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: d866c4a659e74e42a3c37050eae82229 Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:45:25.352149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:45:25.353622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d866c4a659e74e42a3c37050eae82229", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:45:25.353622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:45:25.353622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: d866c4a659e74e42a3c37050eae82229 Jun 22 18:45:25.353622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:45:25.353622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-ServerRescueNegativeTestJSON-1877302870-project Jun 22 18:45:25.353622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:45:25.353622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:45:25.353622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 94d5713dc97f442f916b22d925c35042 Jun 22 18:45:25.353622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1877302870-project Jun 22 18:45:25.353622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:45:25.353622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 5414be47-8679-4c15-9b75-4da9d4d9ac1b could not be found. Jun 22 18:45:25.353622 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '5414be47-8679-4c15-9b75-4da9d4d9ac1b'} Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5414be47-8679-4c15-9b75-4da9d4d9ac1b could not be found. Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:45:25.354854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5414be47-8679-4c15-9b75-4da9d4d9ac1b could not be found. Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5414be47-8679-4c15-9b75-4da9d4d9ac1b could not be found. Jun 22 18:45:25.357125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:25.359680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-fe1c43ae-9aff-4e50-a69e-41e5367280c6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Returning 404 to user: Instance 5414be47-8679-4c15-9b75-4da9d4d9ac1b could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:45:25.359680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-fe1c43ae-9aff-4e50-a69e-41e5367280c6 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b" status: 404 len: 111 microversion: 2.1 time: 0.034404 Jun 22 18:45:25.359680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 410/862] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:25 2022] GET /compute/v2.1/servers/5414be47-8679-4c15-9b75-4da9d4d9ac1b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:45:25.363851 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0c1a694b-3d88-44b4-bcab-fbb1fe8df9b8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:25.364426 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0c1a694b-3d88-44b4-bcab-fbb1fe8df9b8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:25.370759 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0c1a694b-3d88-44b4-bcab-fbb1fe8df9b8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:25.371232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0c1a694b-3d88-44b4-bcab-fbb1fe8df9b8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:25.372026 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0c1a694b-3d88-44b4-bcab-fbb1fe8df9b8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:25.372475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0c1a694b-3d88-44b4-bcab-fbb1fe8df9b8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:25.398649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0c1a694b-3d88-44b4-bcab-fbb1fe8df9b8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Going to try to terminate instance {{(pid=129744) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:45:25.435150 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:25.488868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0c1a694b-3d88-44b4-bcab-fbb1fe8df9b8 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "DELETE /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 204 len: 0 microversion: 2.1 time: 0.128409 Jun 22 18:45:25.492701 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 453/863] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:45:25 2022] DELETE /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:45:25.498488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-40148d2f-9ba3-4f90-8fc8-82a052f4c2fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:25.499099 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-40148d2f-9ba3-4f90-8fc8-82a052f4c2fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:25.506837 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-40148d2f-9ba3-4f90-8fc8-82a052f4c2fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:25.507289 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-40148d2f-9ba3-4f90-8fc8-82a052f4c2fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:25.508158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-40148d2f-9ba3-4f90-8fc8-82a052f4c2fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:25.508592 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-40148d2f-9ba3-4f90-8fc8-82a052f4c2fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:25.644922 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-40148d2f-9ba3-4f90-8fc8-82a052f4c2fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:25.648682 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:25.653800 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-40148d2f-9ba3-4f90-8fc8-82a052f4c2fa tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.159884 Jun 22 18:45:25.654353 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 411/864] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:25 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:25.724804 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7b4ab304-9ba1-4d8d-9d6d-ec83893cec4f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:25.725502 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7b4ab304-9ba1-4d8d-9d6d-ec83893cec4f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:25.732177 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7b4ab304-9ba1-4d8d-9d6d-ec83893cec4f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:25.732630 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7b4ab304-9ba1-4d8d-9d6d-ec83893cec4f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:25.733398 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7b4ab304-9ba1-4d8d-9d6d-ec83893cec4f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:25.733834 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7b4ab304-9ba1-4d8d-9d6d-ec83893cec4f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:25.863855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7b4ab304-9ba1-4d8d-9d6d-ec83893cec4f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:25.871319 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7b4ab304-9ba1-4d8d-9d6d-ec83893cec4f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1361 microversion: 2.1 time: 0.150751 Jun 22 18:45:25.871889 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 454/865] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:25 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:26.671294 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5f04e72f-aed1-4602-9db5-bb5e7cffbfa1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:26.671808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5f04e72f-aed1-4602-9db5-bb5e7cffbfa1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:26.679174 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5f04e72f-aed1-4602-9db5-bb5e7cffbfa1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:26.679598 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5f04e72f-aed1-4602-9db5-bb5e7cffbfa1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:26.680385 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5f04e72f-aed1-4602-9db5-bb5e7cffbfa1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:26.680811 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5f04e72f-aed1-4602-9db5-bb5e7cffbfa1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:26.803217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-41512177-3836-4010-9f57-0f2c33e5e0d4 req-dc4058d8-78f6-4a94-8cb7-b679b12dfdea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bafe5e2-07f8-48e3-b700-aad1a45c4bfc", "tag": "07fd9689-cb5a-4787-85ff-a11df5f3901c"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:26.812888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-41512177-3836-4010-9f57-0f2c33e5e0d4 req-dc4058d8-78f6-4a94-8cb7-b679b12dfdea service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:26.813342 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-41512177-3836-4010-9f57-0f2c33e5e0d4 req-dc4058d8-78f6-4a94-8cb7-b679b12dfdea service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:26.815233 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5f04e72f-aed1-4602-9db5-bb5e7cffbfa1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:26.822639 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5f04e72f-aed1-4602-9db5-bb5e7cffbfa1 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.155818 Jun 22 18:45:26.823236 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 412/866] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:26 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:26.826667 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-41512177-3836-4010-9f57-0f2c33e5e0d4 req-dc4058d8-78f6-4a94-8cb7-b679b12dfdea service nova] Creating event network-changed:07fd9689-cb5a-4787-85ff-a11df5f3901c for instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc on hv-cinder-81268 Jun 22 18:45:26.831399 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-41512177-3836-4010-9f57-0f2c33e5e0d4 req-dc4058d8-78f6-4a94-8cb7-b679b12dfdea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031891 Jun 22 18:45:26.832011 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 455/867] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:45:26.888584 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a66984f2-2345-495f-863f-8dde56220d80 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:26.889180 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a66984f2-2345-495f-863f-8dde56220d80 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:26.895144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a66984f2-2345-495f-863f-8dde56220d80 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:26.895581 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a66984f2-2345-495f-863f-8dde56220d80 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:26.896367 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a66984f2-2345-495f-863f-8dde56220d80 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:26.896794 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a66984f2-2345-495f-863f-8dde56220d80 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:27.027605 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a66984f2-2345-495f-863f-8dde56220d80 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:27.035399 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a66984f2-2345-495f-863f-8dde56220d80 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1361 microversion: 2.1 time: 0.150718 Jun 22 18:45:27.035998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 413/868] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:26 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:27.840207 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c393b8b1-72b3-4e45-b44d-16ca23605d09 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:27.840903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c393b8b1-72b3-4e45-b44d-16ca23605d09 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:27.847085 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c393b8b1-72b3-4e45-b44d-16ca23605d09 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:27.847534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c393b8b1-72b3-4e45-b44d-16ca23605d09 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:27.848318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c393b8b1-72b3-4e45-b44d-16ca23605d09 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:27.848751 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c393b8b1-72b3-4e45-b44d-16ca23605d09 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:27.974286 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c393b8b1-72b3-4e45-b44d-16ca23605d09 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:27.981841 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c393b8b1-72b3-4e45-b44d-16ca23605d09 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.146922 Jun 22 18:45:27.982398 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 456/869] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:27 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:28.052811 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-eec4d737-6e92-4de0-93d3-3be8d0303718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:28.053391 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-eec4d737-6e92-4de0-93d3-3be8d0303718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:28.060473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-eec4d737-6e92-4de0-93d3-3be8d0303718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:28.060914 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-eec4d737-6e92-4de0-93d3-3be8d0303718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:28.061669 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-eec4d737-6e92-4de0-93d3-3be8d0303718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:28.062097 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-eec4d737-6e92-4de0-93d3-3be8d0303718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:28.196305 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-eec4d737-6e92-4de0-93d3-3be8d0303718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:28.203800 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-eec4d737-6e92-4de0-93d3-3be8d0303718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1361 microversion: 2.1 time: 0.154846 Jun 22 18:45:28.204393 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 414/870] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:28 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:28.998820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-76dcb73a-8413-460b-b97c-590a4f11cbbe tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:28.999410 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-76dcb73a-8413-460b-b97c-590a4f11cbbe tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:29.006358 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76dcb73a-8413-460b-b97c-590a4f11cbbe tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:29.006812 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76dcb73a-8413-460b-b97c-590a4f11cbbe tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:29.007585 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76dcb73a-8413-460b-b97c-590a4f11cbbe tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:29.008056 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76dcb73a-8413-460b-b97c-590a4f11cbbe tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:29.138599 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-76dcb73a-8413-460b-b97c-590a4f11cbbe tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:29.146416 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-76dcb73a-8413-460b-b97c-590a4f11cbbe tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.152005 Jun 22 18:45:29.146973 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 457/871] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:28 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:29.221234 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ec443142-8306-4950-a094-5cd1ec5d1b84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:29.221869 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ec443142-8306-4950-a094-5cd1ec5d1b84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:29.227946 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ec443142-8306-4950-a094-5cd1ec5d1b84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:29.228402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ec443142-8306-4950-a094-5cd1ec5d1b84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:29.229165 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ec443142-8306-4950-a094-5cd1ec5d1b84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:29.229601 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ec443142-8306-4950-a094-5cd1ec5d1b84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:29.358556 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ec443142-8306-4950-a094-5cd1ec5d1b84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:29.365960 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ec443142-8306-4950-a094-5cd1ec5d1b84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1361 microversion: 2.1 time: 0.148767 Jun 22 18:45:29.366520 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 415/872] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:29 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:30.164215 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3559ee8d-c1a1-46a8-8463-a3bc3c7d2b20 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:30.164784 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3559ee8d-c1a1-46a8-8463-a3bc3c7d2b20 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:30.171627 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3559ee8d-c1a1-46a8-8463-a3bc3c7d2b20 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:30.172105 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3559ee8d-c1a1-46a8-8463-a3bc3c7d2b20 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:30.174104 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3559ee8d-c1a1-46a8-8463-a3bc3c7d2b20 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:30.174551 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3559ee8d-c1a1-46a8-8463-a3bc3c7d2b20 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:30.306786 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3559ee8d-c1a1-46a8-8463-a3bc3c7d2b20 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:30.314911 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3559ee8d-c1a1-46a8-8463-a3bc3c7d2b20 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1521 microversion: 2.1 time: 0.154649 Jun 22 18:45:30.315475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 458/873] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:30 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:30.382916 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-8aca87a1-1122-42fe-83a9-d50b85379e7f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:30.383515 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-8aca87a1-1122-42fe-83a9-d50b85379e7f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:30.391117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8aca87a1-1122-42fe-83a9-d50b85379e7f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:30.391559 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8aca87a1-1122-42fe-83a9-d50b85379e7f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:30.392357 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8aca87a1-1122-42fe-83a9-d50b85379e7f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:30.392784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8aca87a1-1122-42fe-83a9-d50b85379e7f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:30.948767 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-8aca87a1-1122-42fe-83a9-d50b85379e7f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:30.956231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-8aca87a1-1122-42fe-83a9-d50b85379e7f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1361 microversion: 2.1 time: 0.577136 Jun 22 18:45:30.956781 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 416/874] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:30 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1361 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:31.331913 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b77f6241-be4b-4d01-ad19-945bd5be0254 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:31.332679 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b77f6241-be4b-4d01-ad19-945bd5be0254 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:31.341270 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b77f6241-be4b-4d01-ad19-945bd5be0254 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:31.341722 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b77f6241-be4b-4d01-ad19-945bd5be0254 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:31.342522 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b77f6241-be4b-4d01-ad19-945bd5be0254 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:31.342955 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b77f6241-be4b-4d01-ad19-945bd5be0254 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:31.416733 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b77f6241-be4b-4d01-ad19-945bd5be0254 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94d5713dc97f442f916b22d925c35042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd866c4a659e74e42a3c37050eae82229', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:31.425449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b77f6241-be4b-4d01-ad19-945bd5be0254 tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 200 len: 1479 microversion: 2.1 time: 0.097542 Jun 22 18:45:31.426030 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 459/875] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:31 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 1479 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:45:31.451986 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-74c4a523-0ce8-4770-9d31-39eb54e6c1fb req-d8c2f91b-7255-4a2f-bf54-fd8ad2e718b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66481d9b-408f-4891-8b17-76fface18ff4", "name": "network-vif-deleted", "tag": "1cdce800-1ea9-4867-93b1-faaebd9ff187"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:31.461494 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-74c4a523-0ce8-4770-9d31-39eb54e6c1fb req-d8c2f91b-7255-4a2f-bf54-fd8ad2e718b8 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:31.462033 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-74c4a523-0ce8-4770-9d31-39eb54e6c1fb req-d8c2f91b-7255-4a2f-bf54-fd8ad2e718b8 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:31.475003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-74c4a523-0ce8-4770-9d31-39eb54e6c1fb req-d8c2f91b-7255-4a2f-bf54-fd8ad2e718b8 service nova] Creating event network-vif-deleted:1cdce800-1ea9-4867-93b1-faaebd9ff187 for instance 66481d9b-408f-4891-8b17-76fface18ff4 on hv-cinder-81268 Jun 22 18:45:31.479919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-74c4a523-0ce8-4770-9d31-39eb54e6c1fb req-d8c2f91b-7255-4a2f-bf54-fd8ad2e718b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031645 Jun 22 18:45:31.481104 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 417/876] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:31.973801 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-92ff4985-8f05-4443-95fd-90aede1b0fa4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:31.974403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-92ff4985-8f05-4443-95fd-90aede1b0fa4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:31.980432 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-92ff4985-8f05-4443-95fd-90aede1b0fa4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:31.980987 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-92ff4985-8f05-4443-95fd-90aede1b0fa4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:31.981808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-92ff4985-8f05-4443-95fd-90aede1b0fa4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:31.982247 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-92ff4985-8f05-4443-95fd-90aede1b0fa4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:32.110433 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-92ff4985-8f05-4443-95fd-90aede1b0fa4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:32.117937 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-92ff4985-8f05-4443-95fd-90aede1b0fa4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1361 microversion: 2.1 time: 0.148035 Jun 22 18:45:32.118496 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 460/877] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:31 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:32.439729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:32.440523 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=10 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:32.444942 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a0d06c9f-5d7c-4860-a85a-c514c4242a5f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:32.445636 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a0d06c9f-5d7c-4860-a85a-c514c4242a5f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] [instance: 66481d9b-408f-4891-8b17-76fface18ff4] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:32.454142 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a0d06c9f-5d7c-4860-a85a-c514c4242a5f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:32.454708 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a0d06c9f-5d7c-4860-a85a-c514c4242a5f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:32.455338 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a0d06c9f-5d7c-4860-a85a-c514c4242a5f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:32.455769 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a0d06c9f-5d7c-4860-a85a-c514c4242a5f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:32.469911 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-a0d06c9f-5d7c-4860-a85a-c514c4242a5f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] HTTP exception thrown: Instance 66481d9b-408f-4891-8b17-76fface18ff4 could not be found. Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a0d06c9f-5d7c-4860-a85a-c514c4242a5f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Request method failure captured: Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 HTTP/1.1 Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GNWSRtAX4FCk4LKPpi2_4oWKg9AzU00FZZox6EKvRPv3yOEoSkqMJkrp8JcBA7WmQt8XgNCQItYQFcBY7IUMtSbG8XqaBpHjESKBr-Rg576Nkmc8jTKetJOWTVZ3d5ny-d34E1fPriTEmE5WqlnluiEkCCfs9w6t1LdNoFGljh4Gc Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: d866c4a659e74e42a3c37050eae82229 Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:45:32.471506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:45:32.473044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d866c4a659e74e42a3c37050eae82229", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d866c4a659e74e42a3c37050eae82229"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:45:32.473044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:45:32.473044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: d866c4a659e74e42a3c37050eae82229 Jun 22 18:45:32.473044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1877302870 Jun 22 18:45:32.473044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-ServerRescueNegativeTestJSON-1877302870-project Jun 22 18:45:32.473044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:45:32.473044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:45:32.473044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 94d5713dc97f442f916b22d925c35042 Jun 22 18:45:32.473044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1877302870-project Jun 22 18:45:32.473044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:45:32.473044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 66481d9b-408f-4891-8b17-76fface18ff4 could not be found. Jun 22 18:45:32.473044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '66481d9b-408f-4891-8b17-76fface18ff4'} Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66481d9b-408f-4891-8b17-76fface18ff4 could not be found. Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:45:32.473926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66481d9b-408f-4891-8b17-76fface18ff4 could not be found. Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66481d9b-408f-4891-8b17-76fface18ff4 could not be found. Jun 22 18:45:32.475313 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:32.476605 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a0d06c9f-5d7c-4860-a85a-c514c4242a5f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] Returning 404 to user: Instance 66481d9b-408f-4891-8b17-76fface18ff4 could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:45:32.476605 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a0d06c9f-5d7c-4860-a85a-c514c4242a5f tempest-ServerRescueNegativeTestJSON-1877302870 tempest-ServerRescueNegativeTestJSON-1877302870-project] 10.222.0.18 "GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4" status: 404 len: 111 microversion: 2.1 time: 0.034188 Jun 22 18:45:32.476605 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 418/878] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:32 2022] GET /compute/v2.1/servers/66481d9b-408f-4891-8b17-76fface18ff4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:45:33.134877 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5d0b461c-2393-4759-b265-c15b1d9fd14e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:33.135479 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5d0b461c-2393-4759-b265-c15b1d9fd14e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:33.137813 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:33.143875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5d0b461c-2393-4759-b265-c15b1d9fd14e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:33.144304 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5d0b461c-2393-4759-b265-c15b1d9fd14e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:33.145073 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5d0b461c-2393-4759-b265-c15b1d9fd14e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:33.145501 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5d0b461c-2393-4759-b265-c15b1d9fd14e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:33.199825 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-978ed63a-3542-478e-8c65-28b9aa9cc622 req-93f35321-4bdf-4829-88de-9ebe99e00a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bafe5e2-07f8-48e3-b700-aad1a45c4bfc", "name": "network-vif-plugged", "status": "completed", "tag": "07fd9689-cb5a-4787-85ff-a11df5f3901c"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:33.211682 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-978ed63a-3542-478e-8c65-28b9aa9cc622 req-93f35321-4bdf-4829-88de-9ebe99e00a84 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:33.212764 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-978ed63a-3542-478e-8c65-28b9aa9cc622 req-93f35321-4bdf-4829-88de-9ebe99e00a84 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:33.228758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-978ed63a-3542-478e-8c65-28b9aa9cc622 req-93f35321-4bdf-4829-88de-9ebe99e00a84 service nova] Creating event network-vif-plugged:07fd9689-cb5a-4787-85ff-a11df5f3901c for instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc on hv-cinder-81268 Jun 22 18:45:33.238623 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-978ed63a-3542-478e-8c65-28b9aa9cc622 req-93f35321-4bdf-4829-88de-9ebe99e00a84 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042689 Jun 22 18:45:33.239666 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 419/879] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:45:33.375759 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5d0b461c-2393-4759-b265-c15b1d9fd14e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:33.383914 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5d0b461c-2393-4759-b265-c15b1d9fd14e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1361 microversion: 2.1 time: 0.253126 Jun 22 18:45:33.394404 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 461/880] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:33 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:34.407515 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-71fd4c0e-665f-42fa-9d62-04ef9dd3057a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:34.409584 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-71fd4c0e-665f-42fa-9d62-04ef9dd3057a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:34.420569 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71fd4c0e-665f-42fa-9d62-04ef9dd3057a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:34.421478 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71fd4c0e-665f-42fa-9d62-04ef9dd3057a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:34.422487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71fd4c0e-665f-42fa-9d62-04ef9dd3057a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:34.423122 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71fd4c0e-665f-42fa-9d62-04ef9dd3057a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:34.568528 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-71fd4c0e-665f-42fa-9d62-04ef9dd3057a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:34.577754 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-71fd4c0e-665f-42fa-9d62-04ef9dd3057a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1361 microversion: 2.1 time: 0.178239 Jun 22 18:45:34.578475 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 420/881] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:34 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:45:35.596489 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9e5d45bd-dd7c-4e44-8df8-f8743fa371f4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:35.597243 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9e5d45bd-dd7c-4e44-8df8-f8743fa371f4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:35.627764 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9e5d45bd-dd7c-4e44-8df8-f8743fa371f4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:35.628606 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9e5d45bd-dd7c-4e44-8df8-f8743fa371f4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:35.629200 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9e5d45bd-dd7c-4e44-8df8-f8743fa371f4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:35.629626 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9e5d45bd-dd7c-4e44-8df8-f8743fa371f4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:35.783893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9e5d45bd-dd7c-4e44-8df8-f8743fa371f4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:35.790891 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9e5d45bd-dd7c-4e44-8df8-f8743fa371f4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1548 microversion: 2.1 time: 0.198834 Jun 22 18:45:35.791464 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 462/882] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:35 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1548 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:35.810735 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-09ef631c-0dff-4199-bbb4-1fdc14485f5c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:35.811291 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-09ef631c-0dff-4199-bbb4-1fdc14485f5c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:35.817783 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-09ef631c-0dff-4199-bbb4-1fdc14485f5c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:35.818581 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-09ef631c-0dff-4199-bbb4-1fdc14485f5c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:35.819203 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-09ef631c-0dff-4199-bbb4-1fdc14485f5c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:35.819630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-09ef631c-0dff-4199-bbb4-1fdc14485f5c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:35.909401 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-09ef631c-0dff-4199-bbb4-1fdc14485f5c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103512 Jun 22 18:45:35.909989 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 421/883] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 18:45:35 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:37.143764 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-1e4aa2f3-c272-4b60-8528-cfb613a59925 req-cb46396a-db78-40ab-a5cd-7fbadc399fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bafe5e2-07f8-48e3-b700-aad1a45c4bfc", "tag": "07fd9689-cb5a-4787-85ff-a11df5f3901c"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:37.159619 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-1e4aa2f3-c272-4b60-8528-cfb613a59925 req-cb46396a-db78-40ab-a5cd-7fbadc399fc9 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:37.160092 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-1e4aa2f3-c272-4b60-8528-cfb613a59925 req-cb46396a-db78-40ab-a5cd-7fbadc399fc9 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:37.177968 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-1e4aa2f3-c272-4b60-8528-cfb613a59925 req-cb46396a-db78-40ab-a5cd-7fbadc399fc9 service nova] Creating event network-changed:07fd9689-cb5a-4787-85ff-a11df5f3901c for instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc on hv-cinder-81268 Jun 22 18:45:37.184913 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-1e4aa2f3-c272-4b60-8528-cfb613a59925 req-cb46396a-db78-40ab-a5cd-7fbadc399fc9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044742 Jun 22 18:45:37.191912 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 463/884] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:38.297502 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ba321031-f2a6-404d-9ffe-616153fd5fa3 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] Calling method '.version_select at 0x7fd7554f2310>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:38.306914 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b71a3c32-9f7f-43c1-a890-31543621f66f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:38.307735 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b71a3c32-9f7f-43c1-a890-31543621f66f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:38.324629 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b71a3c32-9f7f-43c1-a890-31543621f66f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:38.325388 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b71a3c32-9f7f-43c1-a890-31543621f66f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:38.326037 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b71a3c32-9f7f-43c1-a890-31543621f66f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:38.326651 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b71a3c32-9f7f-43c1-a890-31543621f66f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:38.353363 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b71a3c32-9f7f-43c1-a890-31543621f66f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2/ips" status: 200 len: 150 microversion: 2.1 time: 0.226713 Jun 22 18:45:38.354153 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 422/885] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 18:45:38 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2/ips => generated 150 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:38.364799 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1f1b0de8-43b3-4c03-8fe0-26215016d634 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab70ab56-84c3-4d90-9bd3-1b3304a3a7bd"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:38.366093 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1f1b0de8-43b3-4c03-8fe0-26215016d634 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:38.366242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ba321031-f2a6-404d-9ffe-616153fd5fa3 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/86adf772-2cf0-430a-8bf7-7dbb125983c4" status: 200 len: 350 microversion: 2.1 time: 0.075994 Jun 22 18:45:38.366808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 464/886] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:45:38 2022] GET /compute/v2.1/os-volumes/86adf772-2cf0-430a-8bf7-7dbb125983c4 => generated 350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:38.373388 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f1b0de8-43b3-4c03-8fe0-26215016d634 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:38.374120 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f1b0de8-43b3-4c03-8fe0-26215016d634 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:38.375085 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f1b0de8-43b3-4c03-8fe0-26215016d634 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:38.375577 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f1b0de8-43b3-4c03-8fe0-26215016d634 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:38.455773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-1f1b0de8-43b3-4c03-8fe0-26215016d634 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Invalid volume: volume ab70ab56-84c3-4d90-9bd3-1b3304a3a7bd is already attached to instances: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1f1b0de8-43b3-4c03-8fe0-26215016d634 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: POST /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2/os-volume_attachments HTTP/1.1 Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 74 Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:45:38.457496 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:45:38.458949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:45:38.458949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:45:38.458949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:45:38.458949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:45:38.458949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:45:38.458949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:45:38.458949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:45:38.458949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:45:38.458949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:45:38.458949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Jun 22 18:45:38.458949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {"volumeAttachment": {"volumeId": "ab70ab56-84c3-4d90-9bd3-1b3304a3a7bd"}} Jun 22 18:45:38.458949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Invalid volume: volume ab70ab56-84c3-4d90-9bd3-1b3304a3a7bd is already attached to instances: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'server_id': 'd5f0f5e4-c6a6-4716-8f93-a67aaea48fa2', 'body': {'volumeAttachment': {'volumeId': 'ab70ab56-84c3-4d90-9bd3-1b3304a3a7bd'}}} Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ab70ab56-84c3-4d90-9bd3-1b3304a3a7bd is already attached to instances: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:38.459758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ab70ab56-84c3-4d90-9bd3-1b3304a3a7bd is already attached to instances: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:38.460927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:38.462077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:38.462077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:45:38.462077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:45:38.462077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ab70ab56-84c3-4d90-9bd3-1b3304a3a7bd is already attached to instances: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc Jun 22 18:45:38.462077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:45:38.462077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1f1b0de8-43b3-4c03-8fe0-26215016d634 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 400 to user: Invalid volume: volume ab70ab56-84c3-4d90-9bd3-1b3304a3a7bd is already attached to instances: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:45:38.462077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1f1b0de8-43b3-4c03-8fe0-26215016d634 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "POST /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098485 Jun 22 18:45:38.462077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 423/887] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:45:38 2022] POST /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 22 18:45:38.469122 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d7f32f9a-5da4-4453-9229-1bb3bf81fd0d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:38.469734 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d7f32f9a-5da4-4453-9229-1bb3bf81fd0d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:38.476440 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d7f32f9a-5da4-4453-9229-1bb3bf81fd0d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:38.476929 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d7f32f9a-5da4-4453-9229-1bb3bf81fd0d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:38.477728 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d7f32f9a-5da4-4453-9229-1bb3bf81fd0d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:38.478198 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d7f32f9a-5da4-4453-9229-1bb3bf81fd0d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:38.504938 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d7f32f9a-5da4-4453-9229-1bb3bf81fd0d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Going to try to terminate instance {{(pid=129744) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:45:38.583792 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d7f32f9a-5da4-4453-9229-1bb3bf81fd0d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 204 len: 0 microversion: 2.1 time: 0.118950 Jun 22 18:45:38.584881 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 465/888] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:45:38 2022] DELETE /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:45:38.597598 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f20254c4-3f3f-4333-8973-626d32eb0bf7 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:38.598208 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f20254c4-3f3f-4333-8973-626d32eb0bf7 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:38.607388 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f20254c4-3f3f-4333-8973-626d32eb0bf7 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:38.607828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f20254c4-3f3f-4333-8973-626d32eb0bf7 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:38.608625 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f20254c4-3f3f-4333-8973-626d32eb0bf7 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:38.609051 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f20254c4-3f3f-4333-8973-626d32eb0bf7 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:38.754411 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f20254c4-3f3f-4333-8973-626d32eb0bf7 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:38.762950 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f20254c4-3f3f-4333-8973-626d32eb0bf7 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1682 microversion: 2.1 time: 0.170671 Jun 22 18:45:38.763505 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 424/889] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:38 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:39.712096 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b787db01-74a7-49fa-9a5b-54c8e0515acc tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] Calling method '.version_select at 0x7fd7554c15e0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:39.759121 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b787db01-74a7-49fa-9a5b-54c8e0515acc tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/43776c43-f52f-4024-932b-33884a1a27d3" status: 200 len: 351 microversion: 2.1 time: 0.051087 Jun 22 18:45:39.759722 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 466/890] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:45:39 2022] GET /compute/v2.1/os-volumes/43776c43-f52f-4024-932b-33884a1a27d3 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:39.780493 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-47cd2592-9cc5-4f74-a21e-ec10642424cf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:39.781250 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-47cd2592-9cc5-4f74-a21e-ec10642424cf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:39.784788 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:39.788844 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-47cd2592-9cc5-4f74-a21e-ec10642424cf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:39.789271 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-47cd2592-9cc5-4f74-a21e-ec10642424cf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:39.790024 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-47cd2592-9cc5-4f74-a21e-ec10642424cf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:39.790449 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-47cd2592-9cc5-4f74-a21e-ec10642424cf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:39.927677 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-47cd2592-9cc5-4f74-a21e-ec10642424cf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:39.936065 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-47cd2592-9cc5-4f74-a21e-ec10642424cf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1682 microversion: 2.1 time: 0.159363 Jun 22 18:45:39.936850 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 425/891] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:39 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:40.955636 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-85eed1b5-930b-4454-8311-91684be68ad9 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:40.957079 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-85eed1b5-930b-4454-8311-91684be68ad9 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:40.963490 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-85eed1b5-930b-4454-8311-91684be68ad9 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:40.963970 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-85eed1b5-930b-4454-8311-91684be68ad9 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:40.965407 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-85eed1b5-930b-4454-8311-91684be68ad9 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:40.965862 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-85eed1b5-930b-4454-8311-91684be68ad9 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:41.027346 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-85eed1b5-930b-4454-8311-91684be68ad9 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:41.035737 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-85eed1b5-930b-4454-8311-91684be68ad9 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 200 len: 1614 microversion: 2.1 time: 0.084522 Jun 22 18:45:41.036509 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 467/892] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:40 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 1614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:41.083435 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1507c76c-3a66-4f37-829f-99c0ea5db0d5 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] Calling method '.version_select at 0x7fd7553dadc0>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:41.137091 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1507c76c-3a66-4f37-829f-99c0ea5db0d5 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c4bd5ef6-19f1-406d-8e7b-ba01ab755592" status: 200 len: 350 microversion: 2.1 time: 0.057111 Jun 22 18:45:41.137677 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 426/893] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:45:41 2022] GET /compute/v2.1/os-volumes/c4bd5ef6-19f1-406d-8e7b-ba01ab755592 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:41.149271 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-bcd200e3-b600-4205-87c9-30504a7cd1c0 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] Calling method '.version_select at 0x7fd75555ad30>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:41.184835 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-41a90f1a-3154-4e89-8e26-9f660f0b0416 req-d6ae3c02-6577-4a72-9cdc-461b9a866d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2", "name": "network-vif-deleted", "tag": "c5ca791e-ba61-4c19-9ffe-a553a1defb00"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:41.197332 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-41a90f1a-3154-4e89-8e26-9f660f0b0416 req-d6ae3c02-6577-4a72-9cdc-461b9a866d88 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:41.198380 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-41a90f1a-3154-4e89-8e26-9f660f0b0416 req-d6ae3c02-6577-4a72-9cdc-461b9a866d88 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:41.214018 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-41a90f1a-3154-4e89-8e26-9f660f0b0416 req-d6ae3c02-6577-4a72-9cdc-461b9a866d88 service nova] Creating event network-vif-deleted:c5ca791e-ba61-4c19-9ffe-a553a1defb00 for instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 on hv-cinder-81268 Jun 22 18:45:41.222259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-41a90f1a-3154-4e89-8e26-9f660f0b0416 req-d6ae3c02-6577-4a72-9cdc-461b9a866d88 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042291 Jun 22 18:45:41.223016 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 427/894] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:41.246913 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-bcd200e3-b600-4205-87c9-30504a7cd1c0 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.101838 Jun 22 18:45:41.247614 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 468/895] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Jun 22 18:45:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:45:41.261734 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-dc08503b-5a15-477b-9a1f-c12267cc9fde tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] Calling method '.version_select at 0x7fd7553daee0>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:41.359032 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-dc08503b-5a15-477b-9a1f-c12267cc9fde tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.102820 Jun 22 18:45:41.359606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 428/896] 10.222.0.18 () {58 vars in 1148 bytes} [Wed Jun 22 18:45:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:41.372119 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-55a25783-1ac2-4099-ae8f-cd1a798f60d7 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] Calling method '.version_select at 0x7fd7555d6dc0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:41.458130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-55a25783-1ac2-4099-ae8f-cd1a798f60d7 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090363 Jun 22 18:45:41.458685 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 469/897] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Jun 22 18:45:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:41.469564 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d02c420b-2598-4747-94c5-8bcbc57e738e tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] Calling method '.version_select at 0x7fd7553f3790>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:41.550534 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d02c420b-2598-4747-94c5-8bcbc57e738e tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084619 Jun 22 18:45:41.551138 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 429/898] 10.222.0.18 () {58 vars in 1166 bytes} [Wed Jun 22 18:45:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:41.562803 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cc958d47-4c1c-4c50-8825-34474244ed05 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] Calling method '.version_select at 0x7fd755525670>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:41.651454 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cc958d47-4c1c-4c50-8825-34474244ed05 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092323 Jun 22 18:45:41.653004 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 470/899] 10.222.0.18 () {58 vars in 1169 bytes} [Wed Jun 22 18:45:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:41.664814 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a62be7bd-26ea-4c6e-89e0-0211fed4d4b8 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] Calling method '.version_select at 0x7fd7553b31f0>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:41.750263 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a62be7bd-26ea-4c6e-89e0-0211fed4d4b8 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089168 Jun 22 18:45:41.750862 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 430/900] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Jun 22 18:45:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:41.762376 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7ad09cf7-a0e2-4bbc-b0f7-c2d3f8e55ce8 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] Calling method '.version_select at 0x7fd75549e310>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:41.847227 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7ad09cf7-a0e2-4bbc-b0f7-c2d3f8e55ce8 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088973 Jun 22 18:45:41.847803 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 471/901] 10.222.0.18 () {58 vars in 1187 bytes} [Wed Jun 22 18:45:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:45:41.860738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b69e3c5a-be6d-4cae-8456-1b4a90ba29e1 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] Calling method '.version_select at 0x7fd7553b38b0>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:41.944512 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b69e3c5a-be6d-4cae-8456-1b4a90ba29e1 tempest-VolumesTestJSON-205304075 tempest-VolumesTestJSON-205304075-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087461 Jun 22 18:45:41.945159 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 431/902] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Jun 22 18:45:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:42.053979 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5db42722-290b-4ef0-a7a1-558654444e0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:42.054585 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5db42722-290b-4ef0-a7a1-558654444e0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:42.056582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:42.068316 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5db42722-290b-4ef0-a7a1-558654444e0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:42.068946 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5db42722-290b-4ef0-a7a1-558654444e0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:42.069890 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5db42722-290b-4ef0-a7a1-558654444e0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:42.070327 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5db42722-290b-4ef0-a7a1-558654444e0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:42.085681 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-5db42722-290b-4ef0-a7a1-558654444e0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5db42722-290b-4ef0-a7a1-558654444e0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 HTTP/1.1 Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:45:42.087344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:45:42.089068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:45:42.089068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:45:42.089068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:45:42.089068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:45:42.089068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:45:42.089068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:45:42.089068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:45:42.089068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:45:42.089068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:45:42.089068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:45:42.089068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:45:42.089068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': 'd5f0f5e4-c6a6-4716-8f93-a67aaea48fa2'} Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:45:42.090796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:45:42.092285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:45:42.093656 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5db42722-290b-4ef0-a7a1-558654444e0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 404 to user: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:45:42.093656 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5db42722-290b-4ef0-a7a1-558654444e0e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 404 len: 111 microversion: 2.1 time: 0.039116 Jun 22 18:45:42.093656 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 472/903] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:42 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:45:42.099276 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7e8245f3-5376-4480-b8fb-e517bd9e2cdd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '.version_select at 0x7fd7553dab80>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:42.121519 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7e8245f3-5376-4480-b8fb-e517bd9e2cdd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-585318712" status: 202 len: 0 microversion: 2.1 time: 0.026633 Jun 22 18:45:42.122094 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 432/904] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jun 22 18:45:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-585318712 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:45:42.800430 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8f1ea326-3e6f-4357-848b-3364a00895b8 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:42.801300 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8f1ea326-3e6f-4357-848b-3364a00895b8 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:42.807539 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8f1ea326-3e6f-4357-848b-3364a00895b8 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:42.808515 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8f1ea326-3e6f-4357-848b-3364a00895b8 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:42.809281 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8f1ea326-3e6f-4357-848b-3364a00895b8 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:42.809719 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8f1ea326-3e6f-4357-848b-3364a00895b8 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:42.889649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-8f1ea326-3e6f-4357-848b-3364a00895b8 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lazy-loading 'services' on Instance uuid 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:45:42.962481 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8f1ea326-3e6f-4357-848b-3364a00895b8 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc/os-volume_attachments/ab70ab56-84c3-4d90-9bd3-1b3304a3a7bd" status: 202 len: 0 microversion: 2.1 time: 0.168149 Jun 22 18:45:42.963151 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 473/905] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 18:45:42 2022] DELETE /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc/os-volume_attachments/ab70ab56-84c3-4d90-9bd3-1b3304a3a7bd => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:45:42.971536 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bcf6082a-30bb-4d83-8741-625287c7ba91 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:42.972591 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bcf6082a-30bb-4d83-8741-625287c7ba91 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:42.978911 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bcf6082a-30bb-4d83-8741-625287c7ba91 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:42.979357 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bcf6082a-30bb-4d83-8741-625287c7ba91 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:42.980334 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bcf6082a-30bb-4d83-8741-625287c7ba91 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:42.980768 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bcf6082a-30bb-4d83-8741-625287c7ba91 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:43.010615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bcf6082a-30bb-4d83-8741-625287c7ba91 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043108 Jun 22 18:45:43.011972 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 433/906] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:45:42 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:44.023780 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-eceb5ae4-05e0-4847-b1aa-634ebe400fde tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:44.024867 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-eceb5ae4-05e0-4847-b1aa-634ebe400fde tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:44.031040 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eceb5ae4-05e0-4847-b1aa-634ebe400fde tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:44.031479 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eceb5ae4-05e0-4847-b1aa-634ebe400fde tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:44.032286 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eceb5ae4-05e0-4847-b1aa-634ebe400fde tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:44.032715 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eceb5ae4-05e0-4847-b1aa-634ebe400fde tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:44.061696 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-eceb5ae4-05e0-4847-b1aa-634ebe400fde tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042799 Jun 22 18:45:44.062225 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 474/907] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:45:44 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 18:45:44.118397 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-685fee4c-2ccb-4093-880e-df69a414508b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:44.118969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-685fee4c-2ccb-4093-880e-df69a414508b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:44.128642 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-685fee4c-2ccb-4093-880e-df69a414508b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:44.129084 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-685fee4c-2ccb-4093-880e-df69a414508b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:44.129872 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-685fee4c-2ccb-4093-880e-df69a414508b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:44.130299 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-685fee4c-2ccb-4093-880e-df69a414508b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:44.156545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-685fee4c-2ccb-4093-880e-df69a414508b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Going to try to terminate instance {{(pid=129743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:45:44.246434 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-685fee4c-2ccb-4093-880e-df69a414508b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 204 len: 0 microversion: 2.1 time: 0.131558 Jun 22 18:45:44.247025 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 434/908] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:45:44 2022] DELETE /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:45:44.255253 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-297ec369-38b6-4300-aac5-dddcc8b28523 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:44.255886 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-297ec369-38b6-4300-aac5-dddcc8b28523 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:44.262221 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-297ec369-38b6-4300-aac5-dddcc8b28523 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:44.262664 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-297ec369-38b6-4300-aac5-dddcc8b28523 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:44.263424 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-297ec369-38b6-4300-aac5-dddcc8b28523 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:44.263870 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-297ec369-38b6-4300-aac5-dddcc8b28523 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:44.283335 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:44.409221 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-297ec369-38b6-4300-aac5-dddcc8b28523 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:44.421298 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-297ec369-38b6-4300-aac5-dddcc8b28523 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1682 microversion: 2.1 time: 0.170096 Jun 22 18:45:44.421887 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 475/909] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:44 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:45.439113 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-36d33954-bf4a-404b-bb67-a1727f6bbb93 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:45.439935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-36d33954-bf4a-404b-bb67-a1727f6bbb93 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:45.446619 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-36d33954-bf4a-404b-bb67-a1727f6bbb93 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:45.447265 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-36d33954-bf4a-404b-bb67-a1727f6bbb93 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:45.448218 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-36d33954-bf4a-404b-bb67-a1727f6bbb93 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:45.449171 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-36d33954-bf4a-404b-bb67-a1727f6bbb93 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:45.586287 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-36d33954-bf4a-404b-bb67-a1727f6bbb93 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:45.593924 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-36d33954-bf4a-404b-bb67-a1727f6bbb93 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1682 microversion: 2.1 time: 0.158928 Jun 22 18:45:45.594419 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 435/910] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:45 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:46.611302 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8fb0a702-7a25-4080-873d-1b1877ee1f55 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:46.612078 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8fb0a702-7a25-4080-873d-1b1877ee1f55 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:46.623352 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8fb0a702-7a25-4080-873d-1b1877ee1f55 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:46.623808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8fb0a702-7a25-4080-873d-1b1877ee1f55 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:46.624609 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8fb0a702-7a25-4080-873d-1b1877ee1f55 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:46.625225 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8fb0a702-7a25-4080-873d-1b1877ee1f55 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:46.690007 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8fb0a702-7a25-4080-873d-1b1877ee1f55 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:46.697551 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8fb0a702-7a25-4080-873d-1b1877ee1f55 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 200 len: 1614 microversion: 2.1 time: 0.090681 Jun 22 18:45:46.698123 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 476/911] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:46 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:47.121363 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-da5336b1-a052-4a65-a0ce-c61d2d12ceb6 req-a5b4089d-584f-4c74-a166-8746558f2c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc", "name": "network-vif-deleted", "tag": "fe5449d7-e40a-4798-93d2-909f1771b70d"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:47.132884 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-da5336b1-a052-4a65-a0ce-c61d2d12ceb6 req-a5b4089d-584f-4c74-a166-8746558f2c6e service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:47.133446 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-da5336b1-a052-4a65-a0ce-c61d2d12ceb6 req-a5b4089d-584f-4c74-a166-8746558f2c6e service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:47.139085 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:45:47.148649 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-da5336b1-a052-4a65-a0ce-c61d2d12ceb6 req-a5b4089d-584f-4c74-a166-8746558f2c6e service nova] Creating event network-vif-deleted:fe5449d7-e40a-4798-93d2-909f1771b70d for instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc on hv-cinder-81268 Jun 22 18:45:47.155087 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-da5336b1-a052-4a65-a0ce-c61d2d12ceb6 req-a5b4089d-584f-4c74-a166-8746558f2c6e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039134 Jun 22 18:45:47.156100 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 436/912] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:47.719618 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-36636052-a332-40fc-a8be-1874f01d6a3e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:47.720654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-36636052-a332-40fc-a8be-1874f01d6a3e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:47.727934 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-36636052-a332-40fc-a8be-1874f01d6a3e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:47.728457 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-36636052-a332-40fc-a8be-1874f01d6a3e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:47.729292 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-36636052-a332-40fc-a8be-1874f01d6a3e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:47.730396 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-36636052-a332-40fc-a8be-1874f01d6a3e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:47.744126 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-36636052-a332-40fc-a8be-1874f01d6a3e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-36636052-a332-40fc-a8be-1874f01d6a3e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc HTTP/1.1 Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:45:47.746465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:45:47.747930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:45:47.747930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:45:47.747930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:45:47.747930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:45:47.747930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:45:47.747930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:45:47.747930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:45:47.747930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:45:47.747930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:45:47.747930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:45:47.747930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:45:47.747930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc'} Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:45:47.748710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:45:47.750622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:45:47.757349 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-36636052-a332-40fc-a8be-1874f01d6a3e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 404 to user: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:45:47.757349 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-36636052-a332-40fc-a8be-1874f01d6a3e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 404 len: 111 microversion: 2.1 time: 0.033366 Jun 22 18:45:47.757349 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 477/913] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:47 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:45:47.758095 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4b1e424a-98cc-4737-a108-dc9a039e1b00 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '.version_select at 0x7fd7553fc5e0>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:47.790235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4b1e424a-98cc-4737-a108-dc9a039e1b00 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544607989" status: 202 len: 0 microversion: 2.1 time: 0.036886 Jun 22 18:45:47.791255 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 437/914] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jun 22 18:45:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544607989 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:45:48.581706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e29cadb6-f6d6-43be-a0cf-a27ceea090d6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Action: 'create', calling method: .version_select at 0x7fd7555b3670>, body: {"keypair": {"name": "tempest-keypair-708331976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhV7T9gLg4bSIVUSyiuVEVGqeEHD1YqRxtnOFoiSqEzmYzDi3KmSpjSkzkYesJcA1oJIMMe4qMycVIkwmsoLkboqYwrjluXwMUAPkvrRZAOa2V8vRXCetHT8UcbNrGmQQ=="}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:48.597709 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-e29cadb6-f6d6-43be-a0cf-a27ceea090d6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'key_pairs'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:45:48.601876 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-e29cadb6-f6d6-43be-a0cf-a27ceea090d6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for user bfa74308096d40daac0a67c9ebec8d8d and project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'key_pairs'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:45:48.629854 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e29cadb6-f6d6-43be-a0cf-a27ceea090d6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051908 Jun 22 18:45:48.630777 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 478/915] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 18:45:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:45:50.067399 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-63417516", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22c9b457-d574-4ec6-85ed-412ef1688a3f"}], "security_groups": [{"name": "tempest-securitygroup--497792528"}], "key_name": "tempest-keypair-708331976", "user_data": "}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:50.194646 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.network.neutron [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] validate_networks() for [('22c9b457-d574-4ec6-85ed-412ef1688a3f', None, None, None, None, None)] {{(pid=129743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:45:50.624891 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Flavor limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:45:50.625597 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Image limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:45:50.626071 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Flavor pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:45:50.626480 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Image pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:45:50.626889 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:45:50.636765 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:50.637218 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:50.638027 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:50.638459 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:50.659248 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:45:50.665374 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for user bfa74308096d40daac0a67c9ebec8d8d and project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:45:50.680184 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Going to run 1 instances... {{(pid=129743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:45:50.684234 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:45:50.741277 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-52427f8f-7e62-45b8-a816-511c9cc3c03a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.678801 Jun 22 18:45:50.742304 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 438/916] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:45:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:45:50.756804 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c9f2c331-ef32-4b3e-abef-dc436fb71c9d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:50.756804 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c9f2c331-ef32-4b3e-abef-dc436fb71c9d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:50.825716 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c9f2c331-ef32-4b3e-abef-dc436fb71c9d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:50.838605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c9f2c331-ef32-4b3e-abef-dc436fb71c9d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1239 microversion: 2.1 time: 0.088791 Jun 22 18:45:50.839530 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 479/917] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:50 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1239 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:51.857009 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1ffe4652-e2fe-4341-b2e4-f5b819c42f34 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:51.858218 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1ffe4652-e2fe-4341-b2e4-f5b819c42f34 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:51.865925 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1ffe4652-e2fe-4341-b2e4-f5b819c42f34 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:51.866739 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1ffe4652-e2fe-4341-b2e4-f5b819c42f34 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:51.867659 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1ffe4652-e2fe-4341-b2e4-f5b819c42f34 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:51.868280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1ffe4652-e2fe-4341-b2e4-f5b819c42f34 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:51.953716 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1ffe4652-e2fe-4341-b2e4-f5b819c42f34 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:51.961234 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1ffe4652-e2fe-4341-b2e4-f5b819c42f34 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1309 microversion: 2.1 time: 0.108793 Jun 22 18:45:51.962116 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 439/918] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:51 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:52.978619 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3def87e0-ab82-4b8e-b884-b4eff45abe6e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:52.979382 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3def87e0-ab82-4b8e-b884-b4eff45abe6e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:52.986498 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3def87e0-ab82-4b8e-b884-b4eff45abe6e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:52.987188 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3def87e0-ab82-4b8e-b884-b4eff45abe6e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:52.988372 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3def87e0-ab82-4b8e-b884-b4eff45abe6e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:52.989119 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3def87e0-ab82-4b8e-b884-b4eff45abe6e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:53.145517 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3def87e0-ab82-4b8e-b884-b4eff45abe6e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:53.154014 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3def87e0-ab82-4b8e-b884-b4eff45abe6e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1364 microversion: 2.1 time: 0.179301 Jun 22 18:45:53.155044 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 480/919] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:52 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:53.323872 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-c9f8b980-c9d4-4760-ad1d-32c53638076b req-0df7ccb3-43eb-4f13-a005-bd3fa040a1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b8c26d-8d82-435d-b4c7-98f8ced7d279", "tag": "186f392c-4dc9-4a86-99dd-a4ad5e725602"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:53.334367 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-c9f8b980-c9d4-4760-ad1d-32c53638076b req-0df7ccb3-43eb-4f13-a005-bd3fa040a1e5 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:53.335233 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-c9f8b980-c9d4-4760-ad1d-32c53638076b req-0df7ccb3-43eb-4f13-a005-bd3fa040a1e5 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:53.358306 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-c9f8b980-c9d4-4760-ad1d-32c53638076b req-0df7ccb3-43eb-4f13-a005-bd3fa040a1e5 service nova] Creating event network-changed:186f392c-4dc9-4a86-99dd-a4ad5e725602 for instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 on hv-cinder-81268 Jun 22 18:45:53.363782 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-c9f8b980-c9d4-4760-ad1d-32c53638076b req-0df7ccb3-43eb-4f13-a005-bd3fa040a1e5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044602 Jun 22 18:45:53.364839 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 440/920] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:45:54.170506 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-31a466cb-e664-41a2-9bbc-f483043cfe8b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:54.171089 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-31a466cb-e664-41a2-9bbc-f483043cfe8b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:54.177710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-31a466cb-e664-41a2-9bbc-f483043cfe8b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:54.178565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-31a466cb-e664-41a2-9bbc-f483043cfe8b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:54.179504 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-31a466cb-e664-41a2-9bbc-f483043cfe8b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:54.180068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-31a466cb-e664-41a2-9bbc-f483043cfe8b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:54.370824 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-31a466cb-e664-41a2-9bbc-f483043cfe8b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:54.378588 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-31a466cb-e664-41a2-9bbc-f483043cfe8b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1364 microversion: 2.1 time: 0.212030 Jun 22 18:45:54.379156 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 481/921] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:54 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:55.396257 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1f4eb678-50f4-4f6e-9463-e379a1bcdc10 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:55.396950 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1f4eb678-50f4-4f6e-9463-e379a1bcdc10 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:55.403638 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f4eb678-50f4-4f6e-9463-e379a1bcdc10 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:55.404113 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f4eb678-50f4-4f6e-9463-e379a1bcdc10 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:55.404890 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f4eb678-50f4-4f6e-9463-e379a1bcdc10 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:55.405326 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1f4eb678-50f4-4f6e-9463-e379a1bcdc10 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:55.537991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1f4eb678-50f4-4f6e-9463-e379a1bcdc10 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:55.546063 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1f4eb678-50f4-4f6e-9463-e379a1bcdc10 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1364 microversion: 2.1 time: 0.154617 Jun 22 18:45:55.546631 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 441/922] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:55 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:56.563021 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-121062f7-e69b-41d5-a627-40123f5b2e00 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:56.563627 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-121062f7-e69b-41d5-a627-40123f5b2e00 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:56.577486 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-121062f7-e69b-41d5-a627-40123f5b2e00 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:56.577984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-121062f7-e69b-41d5-a627-40123f5b2e00 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:56.578799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-121062f7-e69b-41d5-a627-40123f5b2e00 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:56.579239 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-121062f7-e69b-41d5-a627-40123f5b2e00 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:56.715713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-121062f7-e69b-41d5-a627-40123f5b2e00 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:56.728508 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-121062f7-e69b-41d5-a627-40123f5b2e00 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1364 microversion: 2.1 time: 0.169117 Jun 22 18:45:56.729683 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 482/923] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:56 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:57.746550 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bdeee5e6-de12-45a9-b986-2bcd7934be83 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:57.747161 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bdeee5e6-de12-45a9-b986-2bcd7934be83 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:57.754452 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bdeee5e6-de12-45a9-b986-2bcd7934be83 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:57.754909 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bdeee5e6-de12-45a9-b986-2bcd7934be83 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:57.756010 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bdeee5e6-de12-45a9-b986-2bcd7934be83 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:57.756651 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bdeee5e6-de12-45a9-b986-2bcd7934be83 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:57.897098 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bdeee5e6-de12-45a9-b986-2bcd7934be83 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:57.905142 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bdeee5e6-de12-45a9-b986-2bcd7934be83 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1364 microversion: 2.1 time: 0.163362 Jun 22 18:45:57.905718 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 442/924] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:57 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:58.922915 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-76308859-bfb2-41d8-86e9-35de5a0370c1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:58.923528 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-76308859-bfb2-41d8-86e9-35de5a0370c1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:58.931069 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76308859-bfb2-41d8-86e9-35de5a0370c1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:58.931515 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76308859-bfb2-41d8-86e9-35de5a0370c1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:58.932349 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76308859-bfb2-41d8-86e9-35de5a0370c1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:58.933367 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-76308859-bfb2-41d8-86e9-35de5a0370c1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:59.065495 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-76308859-bfb2-41d8-86e9-35de5a0370c1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:45:59.073414 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-76308859-bfb2-41d8-86e9-35de5a0370c1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1364 microversion: 2.1 time: 0.154261 Jun 22 18:45:59.073988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 483/925] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:45:58 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:45:59.134562 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-06eb17b8-4505-4c81-a2df-7543f531890e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:45:59.135632 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-06eb17b8-4505-4c81-a2df-7543f531890e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:45:59.142044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-06eb17b8-4505-4c81-a2df-7543f531890e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:59.142488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-06eb17b8-4505-4c81-a2df-7543f531890e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:59.143256 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-06eb17b8-4505-4c81-a2df-7543f531890e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:59.143689 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-06eb17b8-4505-4c81-a2df-7543f531890e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:59.166790 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-06eb17b8-4505-4c81-a2df-7543f531890e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/ips" status: 200 len: 153 microversion: 2.20 time: 0.036361 Jun 22 18:45:59.167373 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 443/926] 10.222.0.18 () {60 vars in 1288 bytes} [Wed Jun 22 18:45:59 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:45:59.345392 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-d3b4d673-e641-427d-a0b2-750e7f50c197 req-fdb7decc-28f0-4a00-bb80-7fd6140d3bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b8c26d-8d82-435d-b4c7-98f8ced7d279", "name": "network-vif-plugged", "status": "completed", "tag": "186f392c-4dc9-4a86-99dd-a4ad5e725602"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:45:59.357123 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-d3b4d673-e641-427d-a0b2-750e7f50c197 req-fdb7decc-28f0-4a00-bb80-7fd6140d3bad service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:45:59.357628 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-d3b4d673-e641-427d-a0b2-750e7f50c197 req-fdb7decc-28f0-4a00-bb80-7fd6140d3bad service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:45:59.370017 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-d3b4d673-e641-427d-a0b2-750e7f50c197 req-fdb7decc-28f0-4a00-bb80-7fd6140d3bad service nova] Creating event network-vif-plugged:186f392c-4dc9-4a86-99dd-a4ad5e725602 for instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 on hv-cinder-81268 Jun 22 18:45:59.377938 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-d3b4d673-e641-427d-a0b2-750e7f50c197 req-fdb7decc-28f0-4a00-bb80-7fd6140d3bad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039720 Jun 22 18:45:59.378913 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 484/927] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:46:00.090937 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-deecdb46-c8ff-4c38-acf8-9816938bdec0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:00.091516 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-deecdb46-c8ff-4c38-acf8-9816938bdec0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:00.098001 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-deecdb46-c8ff-4c38-acf8-9816938bdec0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:00.098446 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-deecdb46-c8ff-4c38-acf8-9816938bdec0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:00.099223 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-deecdb46-c8ff-4c38-acf8-9816938bdec0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:00.099653 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-deecdb46-c8ff-4c38-acf8-9816938bdec0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:00.229658 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-deecdb46-c8ff-4c38-acf8-9816938bdec0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:00.237589 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-deecdb46-c8ff-4c38-acf8-9816938bdec0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1364 microversion: 2.1 time: 0.151523 Jun 22 18:46:00.238148 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 444/928] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:46:00 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:46:01.252418 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=6 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:01.256962 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ae14a1f4-9da8-41b8-b692-281231f882db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:01.257668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ae14a1f4-9da8-41b8-b692-281231f882db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:01.262549 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3181fa49-b8e3-467b-9c7b-65732c636b76 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:46:01.263078 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3181fa49-b8e3-467b-9c7b-65732c636b76 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:01.264438 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ae14a1f4-9da8-41b8-b692-281231f882db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:01.264894 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ae14a1f4-9da8-41b8-b692-281231f882db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:01.265127 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:01.265886 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ae14a1f4-9da8-41b8-b692-281231f882db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:01.266056 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=6 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:01.266297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ae14a1f4-9da8-41b8-b692-281231f882db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:01.271865 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3181fa49-b8e3-467b-9c7b-65732c636b76 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:01.272353 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3181fa49-b8e3-467b-9c7b-65732c636b76 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:01.273169 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3181fa49-b8e3-467b-9c7b-65732c636b76 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:01.273598 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3181fa49-b8e3-467b-9c7b-65732c636b76 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:01.298539 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.objects.instance [None req-3181fa49-b8e3-467b-9c7b-65732c636b76 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lazy-loading 'flavor' on Instance uuid 63daf967-ba4f-4773-92e1-ac70bc58330a {{(pid=129743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:46:01.411101 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ae14a1f4-9da8-41b8-b692-281231f882db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:01.420006 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ae14a1f4-9da8-41b8-b692-281231f882db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1364 microversion: 2.1 time: 0.169196 Jun 22 18:46:01.420567 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 485/929] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:46:01 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:46:01.575037 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3181fa49-b8e3-467b-9c7b-65732c636b76 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "POST /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/action" status: 202 len: 0 microversion: 2.20 time: 0.316342 Jun 22 18:46:01.575690 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 445/930] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jun 22 18:46:01 2022] POST /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 22 18:46:01.584482 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7fc9ebfa-27da-428e-b288-04a253b53823 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:01.585079 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7fc9ebfa-27da-428e-b288-04a253b53823 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:01.592216 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7fc9ebfa-27da-428e-b288-04a253b53823 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:01.592638 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7fc9ebfa-27da-428e-b288-04a253b53823 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:01.593400 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7fc9ebfa-27da-428e-b288-04a253b53823 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:01.593825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7fc9ebfa-27da-428e-b288-04a253b53823 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:01.723473 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7fc9ebfa-27da-428e-b288-04a253b53823 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:01.731596 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7fc9ebfa-27da-428e-b288-04a253b53823 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:01.733144 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7fc9ebfa-27da-428e-b288-04a253b53823 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:01.734573 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7fc9ebfa-27da-428e-b288-04a253b53823 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.154287 Jun 22 18:46:01.735314 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 486/931] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:01 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:02.437920 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-cd41e856-d06e-4616-acee-7a89eeda813d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:02.438639 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-cd41e856-d06e-4616-acee-7a89eeda813d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:02.445305 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cd41e856-d06e-4616-acee-7a89eeda813d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:02.445750 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cd41e856-d06e-4616-acee-7a89eeda813d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:02.446508 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cd41e856-d06e-4616-acee-7a89eeda813d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:02.446937 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cd41e856-d06e-4616-acee-7a89eeda813d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:02.587561 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cd41e856-d06e-4616-acee-7a89eeda813d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:02.596068 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-cd41e856-d06e-4616-acee-7a89eeda813d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1554 microversion: 2.1 time: 0.163318 Jun 22 18:46:02.596639 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 446/932] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:46:02 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:46:02.612348 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f75293da-4842-4546-a7b9-6766a4f5ab65 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:02.613092 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f75293da-4842-4546-a7b9-6766a4f5ab65 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:02.619531 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f75293da-4842-4546-a7b9-6766a4f5ab65 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:02.620007 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f75293da-4842-4546-a7b9-6766a4f5ab65 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:02.621143 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f75293da-4842-4546-a7b9-6766a4f5ab65 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:02.621321 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f75293da-4842-4546-a7b9-6766a4f5ab65 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:02.703947 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f75293da-4842-4546-a7b9-6766a4f5ab65 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095611 Jun 22 18:46:02.704541 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 487/933] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 18:46:02 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:46:02.757449 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4cecf117-46b9-4144-afe6-d8e676000821 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:02.758052 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-4cecf117-46b9-4144-afe6-d8e676000821 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:02.764837 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4cecf117-46b9-4144-afe6-d8e676000821 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:02.765276 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4cecf117-46b9-4144-afe6-d8e676000821 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:02.766239 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4cecf117-46b9-4144-afe6-d8e676000821 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:02.766722 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4cecf117-46b9-4144-afe6-d8e676000821 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:03.070630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4cecf117-46b9-4144-afe6-d8e676000821 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:03.081560 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4cecf117-46b9-4144-afe6-d8e676000821 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:03.083060 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4cecf117-46b9-4144-afe6-d8e676000821 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:03.084238 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4cecf117-46b9-4144-afe6-d8e676000821 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.330845 Jun 22 18:46:03.084799 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 447/934] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:02 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:04.102785 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d1d97883-7558-480e-81b7-b819b9a43361 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:04.104111 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d1d97883-7558-480e-81b7-b819b9a43361 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:04.111271 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d1d97883-7558-480e-81b7-b819b9a43361 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:04.111726 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d1d97883-7558-480e-81b7-b819b9a43361 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:04.112570 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d1d97883-7558-480e-81b7-b819b9a43361 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:04.113005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d1d97883-7558-480e-81b7-b819b9a43361 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:04.261354 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d1d97883-7558-480e-81b7-b819b9a43361 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:04.270115 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d1d97883-7558-480e-81b7-b819b9a43361 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:04.271850 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d1d97883-7558-480e-81b7-b819b9a43361 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:04.273055 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d1d97883-7558-480e-81b7-b819b9a43361 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.174625 Jun 22 18:46:04.273795 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 488/935] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:04 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:04.369331 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-a87fd8b9-b7b1-4a29-a730-18c60a8bbda4 req-9718dc9c-5f78-48f0-abe8-f67447301834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b8c26d-8d82-435d-b4c7-98f8ced7d279", "tag": "186f392c-4dc9-4a86-99dd-a4ad5e725602"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:46:04.380135 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-a87fd8b9-b7b1-4a29-a730-18c60a8bbda4 req-9718dc9c-5f78-48f0-abe8-f67447301834 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:04.380687 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-a87fd8b9-b7b1-4a29-a730-18c60a8bbda4 req-9718dc9c-5f78-48f0-abe8-f67447301834 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:04.392441 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-a87fd8b9-b7b1-4a29-a730-18c60a8bbda4 req-9718dc9c-5f78-48f0-abe8-f67447301834 service nova] Creating event network-changed:186f392c-4dc9-4a86-99dd-a4ad5e725602 for instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 on hv-cinder-81268 Jun 22 18:46:04.406175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-a87fd8b9-b7b1-4a29-a730-18c60a8bbda4 req-9718dc9c-5f78-48f0-abe8-f67447301834 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036753 Jun 22 18:46:04.406175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 448/936] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:46:05.291186 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e94db413-b5c0-4c3b-bba2-01cc6e833749 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:05.291819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e94db413-b5c0-4c3b-bba2-01cc6e833749 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:05.299249 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e94db413-b5c0-4c3b-bba2-01cc6e833749 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:05.299928 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e94db413-b5c0-4c3b-bba2-01cc6e833749 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:05.300805 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e94db413-b5c0-4c3b-bba2-01cc6e833749 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:05.301283 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e94db413-b5c0-4c3b-bba2-01cc6e833749 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:05.442684 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e94db413-b5c0-4c3b-bba2-01cc6e833749 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:05.452559 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e94db413-b5c0-4c3b-bba2-01cc6e833749 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:05.454057 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e94db413-b5c0-4c3b-bba2-01cc6e833749 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:05.455224 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e94db413-b5c0-4c3b-bba2-01cc6e833749 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.168120 Jun 22 18:46:05.455775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 489/937] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:05 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:06.474986 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2676fa9c-5810-4abf-a540-a955a3706814 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:06.475676 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2676fa9c-5810-4abf-a540-a955a3706814 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:06.482254 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2676fa9c-5810-4abf-a540-a955a3706814 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:06.482699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2676fa9c-5810-4abf-a540-a955a3706814 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:06.483455 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2676fa9c-5810-4abf-a540-a955a3706814 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:06.483906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2676fa9c-5810-4abf-a540-a955a3706814 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:06.612075 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2676fa9c-5810-4abf-a540-a955a3706814 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:06.619958 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2676fa9c-5810-4abf-a540-a955a3706814 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:06.621475 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2676fa9c-5810-4abf-a540-a955a3706814 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:06.623212 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2676fa9c-5810-4abf-a540-a955a3706814 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.153020 Jun 22 18:46:06.623768 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 449/938] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:06 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:07.641866 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c4438c5e-64ee-4472-be3d-ae41c673b8c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:07.642469 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c4438c5e-64ee-4472-be3d-ae41c673b8c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:07.649184 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c4438c5e-64ee-4472-be3d-ae41c673b8c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:07.649632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c4438c5e-64ee-4472-be3d-ae41c673b8c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:07.650398 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c4438c5e-64ee-4472-be3d-ae41c673b8c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:07.650833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c4438c5e-64ee-4472-be3d-ae41c673b8c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:07.793883 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c4438c5e-64ee-4472-be3d-ae41c673b8c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:07.806115 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c4438c5e-64ee-4472-be3d-ae41c673b8c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:07.807657 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c4438c5e-64ee-4472-be3d-ae41c673b8c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:07.808852 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c4438c5e-64ee-4472-be3d-ae41c673b8c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.170936 Jun 22 18:46:07.809475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 490/939] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:07 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:08.828542 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-43be6bf6-11f2-41f3-8efb-3eb32b102bf6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:08.829145 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-43be6bf6-11f2-41f3-8efb-3eb32b102bf6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:08.837159 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-43be6bf6-11f2-41f3-8efb-3eb32b102bf6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:08.837775 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-43be6bf6-11f2-41f3-8efb-3eb32b102bf6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:08.838539 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-43be6bf6-11f2-41f3-8efb-3eb32b102bf6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:08.839091 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-43be6bf6-11f2-41f3-8efb-3eb32b102bf6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:08.976872 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-43be6bf6-11f2-41f3-8efb-3eb32b102bf6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:08.984856 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-43be6bf6-11f2-41f3-8efb-3eb32b102bf6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:08.986377 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-43be6bf6-11f2-41f3-8efb-3eb32b102bf6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:08.987525 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-43be6bf6-11f2-41f3-8efb-3eb32b102bf6 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.164190 Jun 22 18:46:08.988125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 450/940] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:08 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:10.006656 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d185d41b-19ce-4d99-a83f-202fe1819de1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:10.007259 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d185d41b-19ce-4d99-a83f-202fe1819de1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:10.014621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d185d41b-19ce-4d99-a83f-202fe1819de1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:10.015107 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d185d41b-19ce-4d99-a83f-202fe1819de1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:10.015910 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d185d41b-19ce-4d99-a83f-202fe1819de1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:10.016375 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d185d41b-19ce-4d99-a83f-202fe1819de1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:10.143424 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d185d41b-19ce-4d99-a83f-202fe1819de1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:10.151230 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d185d41b-19ce-4d99-a83f-202fe1819de1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:10.152757 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d185d41b-19ce-4d99-a83f-202fe1819de1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:10.154489 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d185d41b-19ce-4d99-a83f-202fe1819de1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.151175 Jun 22 18:46:10.155377 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 491/941] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:10 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:11.173751 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-046ff736-ad67-4dc0-9beb-25d32d525826 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:11.174265 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-046ff736-ad67-4dc0-9beb-25d32d525826 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:11.176742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:11.182247 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-046ff736-ad67-4dc0-9beb-25d32d525826 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:11.182692 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-046ff736-ad67-4dc0-9beb-25d32d525826 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:11.183450 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-046ff736-ad67-4dc0-9beb-25d32d525826 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:11.183904 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-046ff736-ad67-4dc0-9beb-25d32d525826 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:11.318017 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-046ff736-ad67-4dc0-9beb-25d32d525826 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:11.326178 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-046ff736-ad67-4dc0-9beb-25d32d525826 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:11.327669 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-046ff736-ad67-4dc0-9beb-25d32d525826 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:11.328837 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-046ff736-ad67-4dc0-9beb-25d32d525826 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.159863 Jun 22 18:46:11.329395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 451/942] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:11 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:46:12.347230 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-bd996fbe-00f7-423b-ba08-a5ea8f50784e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:12.347828 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-bd996fbe-00f7-423b-ba08-a5ea8f50784e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:12.350226 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:12.355631 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd996fbe-00f7-423b-ba08-a5ea8f50784e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:12.356094 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd996fbe-00f7-423b-ba08-a5ea8f50784e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:12.357566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd996fbe-00f7-423b-ba08-a5ea8f50784e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:12.358081 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd996fbe-00f7-423b-ba08-a5ea8f50784e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:12.491825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bd996fbe-00f7-423b-ba08-a5ea8f50784e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:12.500482 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bd996fbe-00f7-423b-ba08-a5ea8f50784e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:12.502249 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bd996fbe-00f7-423b-ba08-a5ea8f50784e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:12.503385 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-bd996fbe-00f7-423b-ba08-a5ea8f50784e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.160038 Jun 22 18:46:12.503958 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 492/943] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:12 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:13.521419 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f70aba1e-7711-45f6-9d97-fc4e08c528cd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:13.522026 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f70aba1e-7711-45f6-9d97-fc4e08c528cd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:13.528193 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f70aba1e-7711-45f6-9d97-fc4e08c528cd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:13.528639 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f70aba1e-7711-45f6-9d97-fc4e08c528cd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:13.529897 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f70aba1e-7711-45f6-9d97-fc4e08c528cd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:13.530330 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f70aba1e-7711-45f6-9d97-fc4e08c528cd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:13.658582 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f70aba1e-7711-45f6-9d97-fc4e08c528cd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:13.666500 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f70aba1e-7711-45f6-9d97-fc4e08c528cd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:13.668035 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f70aba1e-7711-45f6-9d97-fc4e08c528cd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:13.669181 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f70aba1e-7711-45f6-9d97-fc4e08c528cd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.151688 Jun 22 18:46:13.669742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 452/944] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:13 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:14.687042 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a6b031d3-a53b-4eb1-85a9-8c142dc6e630 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:14.687606 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a6b031d3-a53b-4eb1-85a9-8c142dc6e630 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:14.694173 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a6b031d3-a53b-4eb1-85a9-8c142dc6e630 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:14.694614 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a6b031d3-a53b-4eb1-85a9-8c142dc6e630 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:14.695363 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a6b031d3-a53b-4eb1-85a9-8c142dc6e630 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:14.695788 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a6b031d3-a53b-4eb1-85a9-8c142dc6e630 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:14.699643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=83 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:14.822173 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a6b031d3-a53b-4eb1-85a9-8c142dc6e630 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:14.830688 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a6b031d3-a53b-4eb1-85a9-8c142dc6e630 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:14.832227 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a6b031d3-a53b-4eb1-85a9-8c142dc6e630 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:14.833368 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a6b031d3-a53b-4eb1-85a9-8c142dc6e630 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.150388 Jun 22 18:46:14.833931 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 493/945] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:14 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:15.851702 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e86ebe91-c043-42d1-a809-68c92e80e267 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:15.852306 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e86ebe91-c043-42d1-a809-68c92e80e267 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:15.860257 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e86ebe91-c043-42d1-a809-68c92e80e267 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:15.860706 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e86ebe91-c043-42d1-a809-68c92e80e267 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:15.861464 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e86ebe91-c043-42d1-a809-68c92e80e267 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:15.861895 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e86ebe91-c043-42d1-a809-68c92e80e267 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:15.992202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e86ebe91-c043-42d1-a809-68c92e80e267 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:16.000768 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e86ebe91-c043-42d1-a809-68c92e80e267 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:16.002508 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e86ebe91-c043-42d1-a809-68c92e80e267 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:16.003641 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e86ebe91-c043-42d1-a809-68c92e80e267 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.155918 Jun 22 18:46:16.004230 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 453/946] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:15 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:17.021875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c08e2e38-8d90-4b87-8f03-1f89392f6d9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:17.022480 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c08e2e38-8d90-4b87-8f03-1f89392f6d9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:17.029476 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c08e2e38-8d90-4b87-8f03-1f89392f6d9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:17.029921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c08e2e38-8d90-4b87-8f03-1f89392f6d9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:17.030680 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c08e2e38-8d90-4b87-8f03-1f89392f6d9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:17.031115 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c08e2e38-8d90-4b87-8f03-1f89392f6d9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:17.158995 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c08e2e38-8d90-4b87-8f03-1f89392f6d9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:17.166866 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c08e2e38-8d90-4b87-8f03-1f89392f6d9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:17.168436 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c08e2e38-8d90-4b87-8f03-1f89392f6d9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:17.170267 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c08e2e38-8d90-4b87-8f03-1f89392f6d9a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.152292 Jun 22 18:46:17.170829 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 494/947] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:17 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:18.189324 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-48773c1b-2b86-4be0-8687-078d681a2a8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:18.189999 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-48773c1b-2b86-4be0-8687-078d681a2a8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:18.196958 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-48773c1b-2b86-4be0-8687-078d681a2a8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:18.197400 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-48773c1b-2b86-4be0-8687-078d681a2a8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:18.198203 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-48773c1b-2b86-4be0-8687-078d681a2a8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:18.198658 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-48773c1b-2b86-4be0-8687-078d681a2a8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:18.203400 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:18.334924 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-48773c1b-2b86-4be0-8687-078d681a2a8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:18.343550 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-48773c1b-2b86-4be0-8687-078d681a2a8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:18.345160 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-48773c1b-2b86-4be0-8687-078d681a2a8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:18.346379 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-48773c1b-2b86-4be0-8687-078d681a2a8a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.162171 Jun 22 18:46:18.346948 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 454/948] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:18 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:19.364903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c362fb0d-cd59-4e30-bd92-055799eb1abd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:19.365444 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c362fb0d-cd59-4e30-bd92-055799eb1abd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:19.371792 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c362fb0d-cd59-4e30-bd92-055799eb1abd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:19.373376 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c362fb0d-cd59-4e30-bd92-055799eb1abd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:19.374191 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c362fb0d-cd59-4e30-bd92-055799eb1abd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:19.374628 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c362fb0d-cd59-4e30-bd92-055799eb1abd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:19.510613 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c362fb0d-cd59-4e30-bd92-055799eb1abd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:19.520393 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c362fb0d-cd59-4e30-bd92-055799eb1abd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:19.521903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c362fb0d-cd59-4e30-bd92-055799eb1abd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:19.523097 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c362fb0d-cd59-4e30-bd92-055799eb1abd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1747 microversion: 2.20 time: 0.162227 Jun 22 18:46:19.524353 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 495/949] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:19 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:20.542318 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-006f0c24-90de-4745-8388-0f05258b75dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:20.542923 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-006f0c24-90de-4745-8388-0f05258b75dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:20.549502 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-006f0c24-90de-4745-8388-0f05258b75dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:20.549952 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-006f0c24-90de-4745-8388-0f05258b75dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:20.550715 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-006f0c24-90de-4745-8388-0f05258b75dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:20.551149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-006f0c24-90de-4745-8388-0f05258b75dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:20.681980 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-006f0c24-90de-4745-8388-0f05258b75dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:20.689957 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-006f0c24-90de-4745-8388-0f05258b75dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:20.691465 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-006f0c24-90de-4745-8388-0f05258b75dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:20.692673 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-006f0c24-90de-4745-8388-0f05258b75dd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1747 microversion: 2.20 time: 0.154272 Jun 22 18:46:20.693252 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 455/950] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:20 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:21.710470 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d90ca671-53fc-4842-af29-229481a5531e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:21.711067 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d90ca671-53fc-4842-af29-229481a5531e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:21.718359 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d90ca671-53fc-4842-af29-229481a5531e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:21.718801 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d90ca671-53fc-4842-af29-229481a5531e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:21.719550 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d90ca671-53fc-4842-af29-229481a5531e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:21.720003 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d90ca671-53fc-4842-af29-229481a5531e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:21.856786 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d90ca671-53fc-4842-af29-229481a5531e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:21.865344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d90ca671-53fc-4842-af29-229481a5531e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:21.866834 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d90ca671-53fc-4842-af29-229481a5531e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:21.868004 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d90ca671-53fc-4842-af29-229481a5531e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1747 microversion: 2.20 time: 0.161443 Jun 22 18:46:21.868559 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 496/951] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:21 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:22.887930 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6b17c7a2-881a-424c-9fbd-2acad37b732a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:22.889075 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6b17c7a2-881a-424c-9fbd-2acad37b732a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:22.896398 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6b17c7a2-881a-424c-9fbd-2acad37b732a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:22.896841 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6b17c7a2-881a-424c-9fbd-2acad37b732a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:22.897628 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6b17c7a2-881a-424c-9fbd-2acad37b732a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:22.898056 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6b17c7a2-881a-424c-9fbd-2acad37b732a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:23.027394 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6b17c7a2-881a-424c-9fbd-2acad37b732a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:23.035879 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6b17c7a2-881a-424c-9fbd-2acad37b732a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:23.037390 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6b17c7a2-881a-424c-9fbd-2acad37b732a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:23.038533 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6b17c7a2-881a-424c-9fbd-2acad37b732a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1747 microversion: 2.20 time: 0.154820 Jun 22 18:46:23.039092 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 456/952] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:22 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:23.207965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-b220eea2-b107-4071-9a60-cecee53178d5 req-26ae5dcf-a121-4375-9fa2-cd7c7b119ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63daf967-ba4f-4773-92e1-ac70bc58330a", "name": "network-vif-plugged", "status": "completed", "tag": "d6614812-103b-4720-9cea-4cef6882458e"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:46:23.216022 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-b220eea2-b107-4071-9a60-cecee53178d5 req-26ae5dcf-a121-4375-9fa2-cd7c7b119ee1 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:23.216542 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-b220eea2-b107-4071-9a60-cecee53178d5 req-26ae5dcf-a121-4375-9fa2-cd7c7b119ee1 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:23.228510 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-b220eea2-b107-4071-9a60-cecee53178d5 req-26ae5dcf-a121-4375-9fa2-cd7c7b119ee1 service nova] Creating event network-vif-plugged:d6614812-103b-4720-9cea-4cef6882458e for instance 63daf967-ba4f-4773-92e1-ac70bc58330a on hv-cinder-81268 Jun 22 18:46:23.235930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-b220eea2-b107-4071-9a60-cecee53178d5 req-26ae5dcf-a121-4375-9fa2-cd7c7b119ee1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031757 Jun 22 18:46:23.236639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 497/953] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:46:24.056252 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-8feeaa00-5b28-41f8-b478-395e444dd556 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:24.056792 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-8feeaa00-5b28-41f8-b478-395e444dd556 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:24.063910 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8feeaa00-5b28-41f8-b478-395e444dd556 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:24.064360 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8feeaa00-5b28-41f8-b478-395e444dd556 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:24.065121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8feeaa00-5b28-41f8-b478-395e444dd556 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:24.065557 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8feeaa00-5b28-41f8-b478-395e444dd556 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:24.195067 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-8feeaa00-5b28-41f8-b478-395e444dd556 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:24.204434 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-8feeaa00-5b28-41f8-b478-395e444dd556 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:24.205946 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-8feeaa00-5b28-41f8-b478-395e444dd556 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:24.207109 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-8feeaa00-5b28-41f8-b478-395e444dd556 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1747 microversion: 2.20 time: 0.154861 Jun 22 18:46:24.207675 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 457/954] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:24 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:25.227397 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7a1f6730-2fd2-4ecf-841b-6b6628dfa2c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:25.228026 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7a1f6730-2fd2-4ecf-841b-6b6628dfa2c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:25.234301 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7a1f6730-2fd2-4ecf-841b-6b6628dfa2c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:25.234761 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7a1f6730-2fd2-4ecf-841b-6b6628dfa2c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:25.235508 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7a1f6730-2fd2-4ecf-841b-6b6628dfa2c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:25.235979 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7a1f6730-2fd2-4ecf-841b-6b6628dfa2c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:25.365884 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7a1f6730-2fd2-4ecf-841b-6b6628dfa2c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:25.374530 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7a1f6730-2fd2-4ecf-841b-6b6628dfa2c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:25.376056 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7a1f6730-2fd2-4ecf-841b-6b6628dfa2c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:25.377529 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7a1f6730-2fd2-4ecf-841b-6b6628dfa2c9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1747 microversion: 2.20 time: 0.155026 Jun 22 18:46:25.378065 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 498/955] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:25 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:46:26.394898 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bc31ad2b-f4ac-472a-a2ae-1e72dbfeac44 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:26.395558 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bc31ad2b-f4ac-472a-a2ae-1e72dbfeac44 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:26.402357 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bc31ad2b-f4ac-472a-a2ae-1e72dbfeac44 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:26.402851 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bc31ad2b-f4ac-472a-a2ae-1e72dbfeac44 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:26.404180 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bc31ad2b-f4ac-472a-a2ae-1e72dbfeac44 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:26.405199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bc31ad2b-f4ac-472a-a2ae-1e72dbfeac44 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:26.533689 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bc31ad2b-f4ac-472a-a2ae-1e72dbfeac44 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:26.541475 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bc31ad2b-f4ac-472a-a2ae-1e72dbfeac44 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:26.542962 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bc31ad2b-f4ac-472a-a2ae-1e72dbfeac44 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:26.544188 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bc31ad2b-f4ac-472a-a2ae-1e72dbfeac44 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1747 microversion: 2.20 time: 0.153044 Jun 22 18:46:26.544739 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 458/956] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:26 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:27.562736 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e7933983-0987-485d-9be5-13f9c9da39a1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:27.563336 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e7933983-0987-485d-9be5-13f9c9da39a1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:27.570355 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7933983-0987-485d-9be5-13f9c9da39a1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:27.570941 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7933983-0987-485d-9be5-13f9c9da39a1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:27.571950 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7933983-0987-485d-9be5-13f9c9da39a1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:27.572515 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7933983-0987-485d-9be5-13f9c9da39a1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:27.698705 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e7933983-0987-485d-9be5-13f9c9da39a1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:27.707138 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e7933983-0987-485d-9be5-13f9c9da39a1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:27.708665 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e7933983-0987-485d-9be5-13f9c9da39a1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:27.709829 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e7933983-0987-485d-9be5-13f9c9da39a1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1747 microversion: 2.20 time: 0.151650 Jun 22 18:46:27.710385 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 499/957] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:27 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:28.729124 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f7d7c5e6-ffaa-4180-ae99-a2359c0f6634 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:28.729665 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f7d7c5e6-ffaa-4180-ae99-a2359c0f6634 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:28.737195 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f7d7c5e6-ffaa-4180-ae99-a2359c0f6634 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:28.737667 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f7d7c5e6-ffaa-4180-ae99-a2359c0f6634 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:28.738427 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f7d7c5e6-ffaa-4180-ae99-a2359c0f6634 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:28.738855 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f7d7c5e6-ffaa-4180-ae99-a2359c0f6634 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:28.863431 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f7d7c5e6-ffaa-4180-ae99-a2359c0f6634 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:28.871222 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f7d7c5e6-ffaa-4180-ae99-a2359c0f6634 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:28.873490 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f7d7c5e6-ffaa-4180-ae99-a2359c0f6634 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:28.874652 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f7d7c5e6-ffaa-4180-ae99-a2359c0f6634 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1747 microversion: 2.20 time: 0.149587 Jun 22 18:46:28.875211 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 459/958] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:28 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:29.894326 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7dcfa893-af83-46c6-9c83-451b6815a9b0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:29.894972 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7dcfa893-af83-46c6-9c83-451b6815a9b0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:29.906065 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7dcfa893-af83-46c6-9c83-451b6815a9b0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:29.906516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7dcfa893-af83-46c6-9c83-451b6815a9b0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:29.907334 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7dcfa893-af83-46c6-9c83-451b6815a9b0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:29.907771 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7dcfa893-af83-46c6-9c83-451b6815a9b0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:30.052211 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7dcfa893-af83-46c6-9c83-451b6815a9b0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:30.061143 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7dcfa893-af83-46c6-9c83-451b6815a9b0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:30.062651 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7dcfa893-af83-46c6-9c83-451b6815a9b0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:30.063789 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7dcfa893-af83-46c6-9c83-451b6815a9b0 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1742 microversion: 2.20 time: 0.174558 Jun 22 18:46:30.064446 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 500/959] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:29 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1742 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:31.082848 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e6ef98eb-4c1f-4298-b24b-cd7aba933580 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:31.083450 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e6ef98eb-4c1f-4298-b24b-cd7aba933580 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:31.089636 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e6ef98eb-4c1f-4298-b24b-cd7aba933580 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:31.090078 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e6ef98eb-4c1f-4298-b24b-cd7aba933580 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:31.090848 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e6ef98eb-4c1f-4298-b24b-cd7aba933580 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:31.091279 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e6ef98eb-4c1f-4298-b24b-cd7aba933580 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:31.232216 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e6ef98eb-4c1f-4298-b24b-cd7aba933580 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:31.240129 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e6ef98eb-4c1f-4298-b24b-cd7aba933580 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:31.241612 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e6ef98eb-4c1f-4298-b24b-cd7aba933580 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:31.242742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e6ef98eb-4c1f-4298-b24b-cd7aba933580 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1742 microversion: 2.20 time: 0.164231 Jun 22 18:46:31.243290 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 460/960] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:31 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:32.262486 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d96abef8-c153-41ff-afc4-a18357fe38cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:32.263108 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d96abef8-c153-41ff-afc4-a18357fe38cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:32.270953 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d96abef8-c153-41ff-afc4-a18357fe38cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:32.271676 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d96abef8-c153-41ff-afc4-a18357fe38cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:32.272582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d96abef8-c153-41ff-afc4-a18357fe38cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:32.273015 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d96abef8-c153-41ff-afc4-a18357fe38cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:32.407380 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d96abef8-c153-41ff-afc4-a18357fe38cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:32.415361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d96abef8-c153-41ff-afc4-a18357fe38cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:32.416868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d96abef8-c153-41ff-afc4-a18357fe38cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:32.417996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d96abef8-c153-41ff-afc4-a18357fe38cb tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1742 microversion: 2.20 time: 0.159992 Jun 22 18:46:32.418541 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 501/961] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:32 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:33.440340 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5a054d43-670e-4aca-bef7-700e262006b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:33.441586 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5a054d43-670e-4aca-bef7-700e262006b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:33.448955 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a054d43-670e-4aca-bef7-700e262006b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:33.449667 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a054d43-670e-4aca-bef7-700e262006b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:33.450610 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a054d43-670e-4aca-bef7-700e262006b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:33.451088 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a054d43-670e-4aca-bef7-700e262006b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:33.596626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5a054d43-670e-4aca-bef7-700e262006b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:33.605834 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5a054d43-670e-4aca-bef7-700e262006b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:33.607328 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5a054d43-670e-4aca-bef7-700e262006b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:33.609370 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5a054d43-670e-4aca-bef7-700e262006b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1742 microversion: 2.20 time: 0.174413 Jun 22 18:46:33.610315 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 461/962] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:33 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1742 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:34.634601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-230b542e-d87a-4e9f-b4b1-8fa65a6641f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:34.635124 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-230b542e-d87a-4e9f-b4b1-8fa65a6641f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:34.644645 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-230b542e-d87a-4e9f-b4b1-8fa65a6641f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:34.645869 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-230b542e-d87a-4e9f-b4b1-8fa65a6641f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:34.647091 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-230b542e-d87a-4e9f-b4b1-8fa65a6641f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:34.647599 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-230b542e-d87a-4e9f-b4b1-8fa65a6641f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:34.799338 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-230b542e-d87a-4e9f-b4b1-8fa65a6641f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:34.809465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-230b542e-d87a-4e9f-b4b1-8fa65a6641f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:34.816218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-230b542e-d87a-4e9f-b4b1-8fa65a6641f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:34.818005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-230b542e-d87a-4e9f-b4b1-8fa65a6641f1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1742 microversion: 2.20 time: 0.187740 Jun 22 18:46:34.829868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 502/963] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:34 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:35.837106 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f4f6768e-293b-4b82-bd1c-7d2635544051 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:35.837733 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f4f6768e-293b-4b82-bd1c-7d2635544051 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:35.845319 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f4f6768e-293b-4b82-bd1c-7d2635544051 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:35.845973 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f4f6768e-293b-4b82-bd1c-7d2635544051 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:35.846925 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f4f6768e-293b-4b82-bd1c-7d2635544051 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:35.847551 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f4f6768e-293b-4b82-bd1c-7d2635544051 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:35.991990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f4f6768e-293b-4b82-bd1c-7d2635544051 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:36.033909 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f4f6768e-293b-4b82-bd1c-7d2635544051 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:36.035310 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f4f6768e-293b-4b82-bd1c-7d2635544051 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:36.036763 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f4f6768e-293b-4b82-bd1c-7d2635544051 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1742 microversion: 2.20 time: 0.203412 Jun 22 18:46:36.037090 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 462/964] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:35 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1742 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:37.055798 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-906412f3-fad2-4cb1-bbb5-5f56208782e9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:37.056505 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-906412f3-fad2-4cb1-bbb5-5f56208782e9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:37.066263 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-906412f3-fad2-4cb1-bbb5-5f56208782e9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:37.066711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-906412f3-fad2-4cb1-bbb5-5f56208782e9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:37.067482 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-906412f3-fad2-4cb1-bbb5-5f56208782e9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:37.067938 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-906412f3-fad2-4cb1-bbb5-5f56208782e9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:37.223031 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-906412f3-fad2-4cb1-bbb5-5f56208782e9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:37.232574 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-906412f3-fad2-4cb1-bbb5-5f56208782e9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:37.234531 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-906412f3-fad2-4cb1-bbb5-5f56208782e9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:37.235712 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-906412f3-fad2-4cb1-bbb5-5f56208782e9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1742 microversion: 2.20 time: 0.184745 Jun 22 18:46:37.236310 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 503/965] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:37 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1742 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:38.254678 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c2b2a239-04fb-4bc0-adcd-bc99aedf3dcf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:38.255281 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c2b2a239-04fb-4bc0-adcd-bc99aedf3dcf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:38.262277 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c2b2a239-04fb-4bc0-adcd-bc99aedf3dcf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:38.262727 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c2b2a239-04fb-4bc0-adcd-bc99aedf3dcf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:38.263506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c2b2a239-04fb-4bc0-adcd-bc99aedf3dcf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:38.263976 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c2b2a239-04fb-4bc0-adcd-bc99aedf3dcf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:38.423820 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c2b2a239-04fb-4bc0-adcd-bc99aedf3dcf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:38.432721 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c2b2a239-04fb-4bc0-adcd-bc99aedf3dcf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:38.434227 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c2b2a239-04fb-4bc0-adcd-bc99aedf3dcf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:38.437600 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c2b2a239-04fb-4bc0-adcd-bc99aedf3dcf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1742 microversion: 2.20 time: 0.187185 Jun 22 18:46:38.438178 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 463/966] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:38 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1742 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:39.457457 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4f064c8d-bb49-4164-8c10-1432fe06b144 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:39.458145 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4f064c8d-bb49-4164-8c10-1432fe06b144 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:39.464355 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4f064c8d-bb49-4164-8c10-1432fe06b144 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:39.464811 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4f064c8d-bb49-4164-8c10-1432fe06b144 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:39.465563 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4f064c8d-bb49-4164-8c10-1432fe06b144 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:39.465990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4f064c8d-bb49-4164-8c10-1432fe06b144 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:39.620603 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4f064c8d-bb49-4164-8c10-1432fe06b144 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:39.630187 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4f064c8d-bb49-4164-8c10-1432fe06b144 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:39.631680 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4f064c8d-bb49-4164-8c10-1432fe06b144 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:39.632856 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4f064c8d-bb49-4164-8c10-1432fe06b144 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1742 microversion: 2.20 time: 0.180698 Jun 22 18:46:39.634745 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 504/967] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:39 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1742 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:40.652855 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-431bd2f0-0a9c-4203-b3b7-2b3bf0267aee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:40.653459 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-431bd2f0-0a9c-4203-b3b7-2b3bf0267aee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:40.660905 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-431bd2f0-0a9c-4203-b3b7-2b3bf0267aee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:40.661276 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-431bd2f0-0a9c-4203-b3b7-2b3bf0267aee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:40.662037 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-431bd2f0-0a9c-4203-b3b7-2b3bf0267aee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:40.662464 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-431bd2f0-0a9c-4203-b3b7-2b3bf0267aee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:40.800745 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-431bd2f0-0a9c-4203-b3b7-2b3bf0267aee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:40.808878 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-431bd2f0-0a9c-4203-b3b7-2b3bf0267aee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:40.810426 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-431bd2f0-0a9c-4203-b3b7-2b3bf0267aee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:40.811707 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-431bd2f0-0a9c-4203-b3b7-2b3bf0267aee tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1742 microversion: 2.20 time: 0.162757 Jun 22 18:46:40.812303 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 464/968] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:40 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:41.830307 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a9c382a3-c563-4a3c-9e95-cd5def40110b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:41.830910 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a9c382a3-c563-4a3c-9e95-cd5def40110b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:41.837592 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a9c382a3-c563-4a3c-9e95-cd5def40110b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:41.838043 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a9c382a3-c563-4a3c-9e95-cd5def40110b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:41.838802 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a9c382a3-c563-4a3c-9e95-cd5def40110b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:41.839234 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a9c382a3-c563-4a3c-9e95-cd5def40110b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:41.969617 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a9c382a3-c563-4a3c-9e95-cd5def40110b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:41.977476 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a9c382a3-c563-4a3c-9e95-cd5def40110b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:41.978975 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a9c382a3-c563-4a3c-9e95-cd5def40110b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:41.980132 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a9c382a3-c563-4a3c-9e95-cd5def40110b tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1724 microversion: 2.20 time: 0.153972 Jun 22 18:46:41.980688 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 505/969] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:41 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:42.998384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f35c7375-c0af-4823-b829-df503990caf8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:42.999131 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f35c7375-c0af-4823-b829-df503990caf8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:43.001712 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=28 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:43.007294 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f35c7375-c0af-4823-b829-df503990caf8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:43.007886 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f35c7375-c0af-4823-b829-df503990caf8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:43.008720 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f35c7375-c0af-4823-b829-df503990caf8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:43.009157 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f35c7375-c0af-4823-b829-df503990caf8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:43.149780 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f35c7375-c0af-4823-b829-df503990caf8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:43.159213 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f35c7375-c0af-4823-b829-df503990caf8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:43.160695 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f35c7375-c0af-4823-b829-df503990caf8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:43.161921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f35c7375-c0af-4823-b829-df503990caf8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1724 microversion: 2.20 time: 0.167303 Jun 22 18:46:43.162469 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 465/970] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:42 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:44.181124 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f8b32c1b-b3b3-4f20-b3e9-3fcdf5c1495c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:44.181755 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f8b32c1b-b3b3-4f20-b3e9-3fcdf5c1495c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:44.184183 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=28 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:44.190546 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f8b32c1b-b3b3-4f20-b3e9-3fcdf5c1495c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:44.190990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f8b32c1b-b3b3-4f20-b3e9-3fcdf5c1495c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:44.191755 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f8b32c1b-b3b3-4f20-b3e9-3fcdf5c1495c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:44.192215 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f8b32c1b-b3b3-4f20-b3e9-3fcdf5c1495c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:44.323499 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f8b32c1b-b3b3-4f20-b3e9-3fcdf5c1495c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:44.332332 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f8b32c1b-b3b3-4f20-b3e9-3fcdf5c1495c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:44.333914 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f8b32c1b-b3b3-4f20-b3e9-3fcdf5c1495c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:44.335138 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f8b32c1b-b3b3-4f20-b3e9-3fcdf5c1495c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1667 microversion: 2.20 time: 0.157911 Jun 22 18:46:44.335699 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 506/971] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:44 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:44.353400 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-59be9721-2e03-4861-be07-aa7ec2c897ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1273934-280c-4eab-beb2-a7982cf75cfc"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:46:44.354540 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-59be9721-2e03-4861-be07-aa7ec2c897ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:44.362545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-59be9721-2e03-4861-be07-aa7ec2c897ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:44.362990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-59be9721-2e03-4861-be07-aa7ec2c897ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:44.364079 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-59be9721-2e03-4861-be07-aa7ec2c897ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:44.364522 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-59be9721-2e03-4861-be07-aa7ec2c897ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:44.645637 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-59be9721-2e03-4861-be07-aa7ec2c897ae tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "POST /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295987 Jun 22 18:46:44.646290 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 466/972] 10.222.0.18 () {62 vars in 1363 bytes} [Wed Jun 22 18:46:44 2022] POST /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 18:46:44.764711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6bbb7a7c-7b2e-4654-89ad-7f9dfff6b743 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:44.765252 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6bbb7a7c-7b2e-4654-89ad-7f9dfff6b743 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:44.771300 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6bbb7a7c-7b2e-4654-89ad-7f9dfff6b743 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:44.771741 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6bbb7a7c-7b2e-4654-89ad-7f9dfff6b743 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:44.772531 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6bbb7a7c-7b2e-4654-89ad-7f9dfff6b743 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:44.772960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6bbb7a7c-7b2e-4654-89ad-7f9dfff6b743 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:44.775496 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=80 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:45.011141 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6bbb7a7c-7b2e-4654-89ad-7f9dfff6b743 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "DELETE /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/os-volume_attachments/e1273934-280c-4eab-beb2-a7982cf75cfc" status: 202 len: 0 microversion: 2.20 time: 0.250902 Jun 22 18:46:45.011719 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 507/973] 10.222.0.18 () {60 vars in 1456 bytes} [Wed Jun 22 18:46:44 2022] DELETE /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/os-volume_attachments/e1273934-280c-4eab-beb2-a7982cf75cfc => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:46:45.069568 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5a3dc11c-411f-4809-b575-18c533a7bd94 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:46:45.070141 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5a3dc11c-411f-4809-b575-18c533a7bd94 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:45.076342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a3dc11c-411f-4809-b575-18c533a7bd94 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:45.077384 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a3dc11c-411f-4809-b575-18c533a7bd94 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:45.078230 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a3dc11c-411f-4809-b575-18c533a7bd94 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:45.078669 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a3dc11c-411f-4809-b575-18c533a7bd94 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:45.283825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-0dc5c6bd-e6a2-4339-91f8-5d2d34dc2231 req-f9ab004c-b1fb-4de7-97da-2c8cf2fec997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63daf967-ba4f-4773-92e1-ac70bc58330a", "name": "network-vif-unplugged", "status": "completed", "tag": "d6614812-103b-4720-9cea-4cef6882458e"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:46:45.291223 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:46:45.295075 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-0dc5c6bd-e6a2-4339-91f8-5d2d34dc2231 req-f9ab004c-b1fb-4de7-97da-2c8cf2fec997 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:45.296386 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-0dc5c6bd-e6a2-4339-91f8-5d2d34dc2231 req-f9ab004c-b1fb-4de7-97da-2c8cf2fec997 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:45.309420 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.compute.server_external_events [req-0dc5c6bd-e6a2-4339-91f8-5d2d34dc2231 req-f9ab004c-b1fb-4de7-97da-2c8cf2fec997 service nova] Unable to find a host for instance 63daf967-ba4f-4773-92e1-ac70bc58330a. Dropping event network-vif-unplugged {{(pid=129744) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 18:46:45.310418 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-0dc5c6bd-e6a2-4339-91f8-5d2d34dc2231 req-f9ab004c-b1fb-4de7-97da-2c8cf2fec997 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030939 Jun 22 18:46:45.311660 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 508/974] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 22 18:46:45.330547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5a3dc11c-411f-4809-b575-18c533a7bd94 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "POST /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/action" status: 202 len: 0 microversion: 2.20 time: 0.264838 Jun 22 18:46:45.331173 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 467/975] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jun 22 18:46:45 2022] POST /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:46:45.348853 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-521478b7-ddbd-4666-ab0a-cfd5a064ef33 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:45.349459 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-521478b7-ddbd-4666-ab0a-cfd5a064ef33 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:45.355975 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-521478b7-ddbd-4666-ab0a-cfd5a064ef33 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:45.356737 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-521478b7-ddbd-4666-ab0a-cfd5a064ef33 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:45.358368 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-521478b7-ddbd-4666-ab0a-cfd5a064ef33 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:45.359338 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-521478b7-ddbd-4666-ab0a-cfd5a064ef33 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:45.536001 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-521478b7-ddbd-4666-ab0a-cfd5a064ef33 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:45.548861 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-521478b7-ddbd-4666-ab0a-cfd5a064ef33 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:45.550514 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-521478b7-ddbd-4666-ab0a-cfd5a064ef33 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:45.551770 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-521478b7-ddbd-4666-ab0a-cfd5a064ef33 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1675 microversion: 2.20 time: 0.206782 Jun 22 18:46:45.552779 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 509/976] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:45 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:46.571088 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6e0970de-63d4-496c-b740-529d191c5d28 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:46.572400 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6e0970de-63d4-496c-b740-529d191c5d28 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:46.580783 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6e0970de-63d4-496c-b740-529d191c5d28 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:46.581233 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6e0970de-63d4-496c-b740-529d191c5d28 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:46.582003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6e0970de-63d4-496c-b740-529d191c5d28 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:46.582566 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6e0970de-63d4-496c-b740-529d191c5d28 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:47.051470 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6e0970de-63d4-496c-b740-529d191c5d28 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:47.059929 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6e0970de-63d4-496c-b740-529d191c5d28 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:47.062265 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6e0970de-63d4-496c-b740-529d191c5d28 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:47.063653 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6e0970de-63d4-496c-b740-529d191c5d28 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.497208 Jun 22 18:46:47.064233 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 468/977] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:46 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:46:48.082266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-619846b4-9358-4eb3-99e1-7ea277cd58bd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:48.083253 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-619846b4-9358-4eb3-99e1-7ea277cd58bd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:48.090545 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-619846b4-9358-4eb3-99e1-7ea277cd58bd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:48.091197 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-619846b4-9358-4eb3-99e1-7ea277cd58bd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:48.092909 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-619846b4-9358-4eb3-99e1-7ea277cd58bd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:48.094100 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-619846b4-9358-4eb3-99e1-7ea277cd58bd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:48.277402 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-619846b4-9358-4eb3-99e1-7ea277cd58bd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:48.292883 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-619846b4-9358-4eb3-99e1-7ea277cd58bd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:48.294834 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-619846b4-9358-4eb3-99e1-7ea277cd58bd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:48.297246 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-619846b4-9358-4eb3-99e1-7ea277cd58bd tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.218891 Jun 22 18:46:48.299143 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 510/978] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:48 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:49.317231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-0d6c4511-8caf-4f20-9cbb-8121feb0c252 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:49.318817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0d6c4511-8caf-4f20-9cbb-8121feb0c252 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:49.326429 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0d6c4511-8caf-4f20-9cbb-8121feb0c252 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:49.327903 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0d6c4511-8caf-4f20-9cbb-8121feb0c252 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:49.329503 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0d6c4511-8caf-4f20-9cbb-8121feb0c252 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:49.330901 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0d6c4511-8caf-4f20-9cbb-8121feb0c252 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:49.583719 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-0d6c4511-8caf-4f20-9cbb-8121feb0c252 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:49.595257 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-0d6c4511-8caf-4f20-9cbb-8121feb0c252 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:49.597590 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-0d6c4511-8caf-4f20-9cbb-8121feb0c252 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:49.599024 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-0d6c4511-8caf-4f20-9cbb-8121feb0c252 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.286090 Jun 22 18:46:49.612171 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 469/979] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:49 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:50.618514 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a6ae4951-6b5b-4911-914e-1b817f8dc64f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:50.619108 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a6ae4951-6b5b-4911-914e-1b817f8dc64f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:50.625668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a6ae4951-6b5b-4911-914e-1b817f8dc64f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:50.626112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a6ae4951-6b5b-4911-914e-1b817f8dc64f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:50.627116 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a6ae4951-6b5b-4911-914e-1b817f8dc64f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:50.627543 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a6ae4951-6b5b-4911-914e-1b817f8dc64f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:50.774378 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a6ae4951-6b5b-4911-914e-1b817f8dc64f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:50.783225 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a6ae4951-6b5b-4911-914e-1b817f8dc64f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:50.785153 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a6ae4951-6b5b-4911-914e-1b817f8dc64f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:50.786643 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a6ae4951-6b5b-4911-914e-1b817f8dc64f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.172102 Jun 22 18:46:50.787450 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 511/980] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:50 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:51.805130 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-00e29c5b-2197-4848-83db-4b6a62af3ea3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:51.805734 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-00e29c5b-2197-4848-83db-4b6a62af3ea3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:51.812288 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-00e29c5b-2197-4848-83db-4b6a62af3ea3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:51.812738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-00e29c5b-2197-4848-83db-4b6a62af3ea3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:51.813500 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-00e29c5b-2197-4848-83db-4b6a62af3ea3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:51.813937 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-00e29c5b-2197-4848-83db-4b6a62af3ea3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:51.942680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-00e29c5b-2197-4848-83db-4b6a62af3ea3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:51.950480 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-00e29c5b-2197-4848-83db-4b6a62af3ea3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:51.952528 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-00e29c5b-2197-4848-83db-4b6a62af3ea3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:51.953671 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-00e29c5b-2197-4848-83db-4b6a62af3ea3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.152423 Jun 22 18:46:51.954221 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 470/981] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:51 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:52.973971 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b118c0e0-6891-4b63-a303-6489ad3d5a8d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:52.974631 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b118c0e0-6891-4b63-a303-6489ad3d5a8d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:52.981190 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b118c0e0-6891-4b63-a303-6489ad3d5a8d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:52.981640 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b118c0e0-6891-4b63-a303-6489ad3d5a8d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:52.982488 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b118c0e0-6891-4b63-a303-6489ad3d5a8d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:52.983599 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b118c0e0-6891-4b63-a303-6489ad3d5a8d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:53.129304 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b118c0e0-6891-4b63-a303-6489ad3d5a8d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:53.137275 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b118c0e0-6891-4b63-a303-6489ad3d5a8d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:53.139444 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b118c0e0-6891-4b63-a303-6489ad3d5a8d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:53.140620 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b118c0e0-6891-4b63-a303-6489ad3d5a8d tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.171572 Jun 22 18:46:53.141165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 512/982] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:52 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:54.159224 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a8a8e374-bbe7-4bd8-9bf9-7b93b03c82fe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:54.159789 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a8a8e374-bbe7-4bd8-9bf9-7b93b03c82fe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:54.166672 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a8a8e374-bbe7-4bd8-9bf9-7b93b03c82fe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:54.167124 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a8a8e374-bbe7-4bd8-9bf9-7b93b03c82fe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:54.167921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a8a8e374-bbe7-4bd8-9bf9-7b93b03c82fe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:54.168485 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a8a8e374-bbe7-4bd8-9bf9-7b93b03c82fe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:54.308234 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a8a8e374-bbe7-4bd8-9bf9-7b93b03c82fe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:54.316785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a8a8e374-bbe7-4bd8-9bf9-7b93b03c82fe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:54.318284 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a8a8e374-bbe7-4bd8-9bf9-7b93b03c82fe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:54.319437 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a8a8e374-bbe7-4bd8-9bf9-7b93b03c82fe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.164239 Jun 22 18:46:54.320015 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 471/983] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:54 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:55.338263 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-43acf729-9c47-41a4-a459-d2ee65724cbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:55.338861 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-43acf729-9c47-41a4-a459-d2ee65724cbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:55.345469 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43acf729-9c47-41a4-a459-d2ee65724cbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:55.345910 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43acf729-9c47-41a4-a459-d2ee65724cbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:55.346660 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43acf729-9c47-41a4-a459-d2ee65724cbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:55.347087 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43acf729-9c47-41a4-a459-d2ee65724cbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:55.480321 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-43acf729-9c47-41a4-a459-d2ee65724cbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:55.488337 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-43acf729-9c47-41a4-a459-d2ee65724cbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:55.489834 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-43acf729-9c47-41a4-a459-d2ee65724cbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:55.490959 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-43acf729-9c47-41a4-a459-d2ee65724cbe tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.156546 Jun 22 18:46:55.491511 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 513/984] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:55 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:56.509693 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a3576486-cc02-4a71-8905-fc0afda9055f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:56.510278 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a3576486-cc02-4a71-8905-fc0afda9055f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:56.516875 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a3576486-cc02-4a71-8905-fc0afda9055f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:56.517312 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a3576486-cc02-4a71-8905-fc0afda9055f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:56.518066 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a3576486-cc02-4a71-8905-fc0afda9055f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:56.518492 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a3576486-cc02-4a71-8905-fc0afda9055f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:56.662211 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a3576486-cc02-4a71-8905-fc0afda9055f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:56.671149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a3576486-cc02-4a71-8905-fc0afda9055f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:56.672663 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a3576486-cc02-4a71-8905-fc0afda9055f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:56.673800 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a3576486-cc02-4a71-8905-fc0afda9055f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.168061 Jun 22 18:46:56.674352 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 472/985] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:56 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:57.692367 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-dc6e9e8d-cc7a-47aa-a9d5-f15606357d55 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:57.692988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-dc6e9e8d-cc7a-47aa-a9d5-f15606357d55 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:57.699598 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dc6e9e8d-cc7a-47aa-a9d5-f15606357d55 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:57.700081 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dc6e9e8d-cc7a-47aa-a9d5-f15606357d55 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:57.700920 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dc6e9e8d-cc7a-47aa-a9d5-f15606357d55 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:57.702176 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dc6e9e8d-cc7a-47aa-a9d5-f15606357d55 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:57.854544 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dc6e9e8d-cc7a-47aa-a9d5-f15606357d55 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:57.863587 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dc6e9e8d-cc7a-47aa-a9d5-f15606357d55 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:57.865649 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dc6e9e8d-cc7a-47aa-a9d5-f15606357d55 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:57.866896 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-dc6e9e8d-cc7a-47aa-a9d5-f15606357d55 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.178472 Jun 22 18:46:57.867651 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 514/986] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:57 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:58.535071 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-879004912", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "networks": [{"uuid": "cfd8a78e-1ba4-49d7-8b2c-aca1dbfae09f"}]}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:46:58.590995 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.network.neutron [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] validate_networks() for [('cfd8a78e-1ba4-49d7-8b2c-aca1dbfae09f', None, None, None, None, None)] {{(pid=129743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:46:58.887116 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cad3ac8b-cc4b-4a31-b96b-94fe58708220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:58.887719 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cad3ac8b-cc4b-4a31-b96b-94fe58708220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:58.895635 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cad3ac8b-cc4b-4a31-b96b-94fe58708220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:58.896450 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cad3ac8b-cc4b-4a31-b96b-94fe58708220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:58.897413 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cad3ac8b-cc4b-4a31-b96b-94fe58708220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:58.898005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cad3ac8b-cc4b-4a31-b96b-94fe58708220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:58.975881 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Flavor limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:46:58.976586 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Image limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:46:58.977177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Flavor pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:46:58.977678 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Image pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:46:58.978181 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:46:58.988529 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:58.988975 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:58.989771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:46:58.990199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:46:59.016427 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Getting quotas for project 500e8157246e450ea87f751218856c7a. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:46:59.021278 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Getting quotas for user 5b995c6bf02b4e50aa836324c6f3414e and project 500e8157246e450ea87f751218856c7a. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:46:59.034730 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Going to run 1 instances... {{(pid=129743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:46:59.038298 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:46:59.083466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cad3ac8b-cc4b-4a31-b96b-94fe58708220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:59.090457 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-0c66e312-6487-46cd-b4dc-df0ab0bc4afe tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559216 Jun 22 18:46:59.091449 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 473/987] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:46:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:46:59.093371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cad3ac8b-cc4b-4a31-b96b-94fe58708220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:59.094922 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cad3ac8b-cc4b-4a31-b96b-94fe58708220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:59.096131 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cad3ac8b-cc4b-4a31-b96b-94fe58708220 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.212869 Jun 22 18:46:59.103356 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-70e1eea0-3251-467b-881a-5d757924d7e1 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:46:59.103998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-70e1eea0-3251-467b-881a-5d757924d7e1 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:46:59.108422 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 515/988] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:46:58 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:46:59.169420 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-70e1eea0-3251-467b-881a-5d757924d7e1 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:46:59.179383 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-70e1eea0-3251-467b-881a-5d757924d7e1 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1218 microversion: 2.1 time: 0.080914 Jun 22 18:46:59.180397 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 474/989] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:46:59 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:47:00.114859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-dfc12269-7c5a-410e-b3dc-131be6d5db2a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:00.115447 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-dfc12269-7c5a-410e-b3dc-131be6d5db2a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:00.121782 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dfc12269-7c5a-410e-b3dc-131be6d5db2a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:00.122224 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dfc12269-7c5a-410e-b3dc-131be6d5db2a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:00.122979 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dfc12269-7c5a-410e-b3dc-131be6d5db2a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:00.123507 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dfc12269-7c5a-410e-b3dc-131be6d5db2a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:00.197297 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f14a03e3-473d-4630-9ae5-34c68348d770 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:00.197915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f14a03e3-473d-4630-9ae5-34c68348d770 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:00.204946 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f14a03e3-473d-4630-9ae5-34c68348d770 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:00.205467 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f14a03e3-473d-4630-9ae5-34c68348d770 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:00.206239 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f14a03e3-473d-4630-9ae5-34c68348d770 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:00.206673 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f14a03e3-473d-4630-9ae5-34c68348d770 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:00.259452 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dfc12269-7c5a-410e-b3dc-131be6d5db2a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:00.268109 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dfc12269-7c5a-410e-b3dc-131be6d5db2a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:00.268274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f14a03e3-473d-4630-9ae5-34c68348d770 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:00.269609 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dfc12269-7c5a-410e-b3dc-131be6d5db2a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:00.270746 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-dfc12269-7c5a-410e-b3dc-131be6d5db2a tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.159927 Jun 22 18:47:00.271295 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 516/990] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:47:00 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:47:00.275891 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f14a03e3-473d-4630-9ae5-34c68348d770 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1222 microversion: 2.1 time: 0.082433 Jun 22 18:47:00.276524 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 475/991] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:00 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:47:01.289521 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3a347810-558d-4c3d-b673-9f686a2000bf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:01.290066 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3a347810-558d-4c3d-b673-9f686a2000bf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:01.293090 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-159ad014-1442-4f86-b12a-3dc016cc3551 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:01.293771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-159ad014-1442-4f86-b12a-3dc016cc3551 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:01.297433 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3a347810-558d-4c3d-b673-9f686a2000bf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:01.297886 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3a347810-558d-4c3d-b673-9f686a2000bf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:01.298661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3a347810-558d-4c3d-b673-9f686a2000bf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:01.299088 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3a347810-558d-4c3d-b673-9f686a2000bf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:01.301378 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-159ad014-1442-4f86-b12a-3dc016cc3551 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:01.301836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-159ad014-1442-4f86-b12a-3dc016cc3551 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:01.302611 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-159ad014-1442-4f86-b12a-3dc016cc3551 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:01.303187 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-159ad014-1442-4f86-b12a-3dc016cc3551 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:01.378084 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-159ad014-1442-4f86-b12a-3dc016cc3551 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:01.385731 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-159ad014-1442-4f86-b12a-3dc016cc3551 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1222 microversion: 2.1 time: 0.096646 Jun 22 18:47:01.386604 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 476/992] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:01 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:47:01.446524 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3a347810-558d-4c3d-b673-9f686a2000bf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:01.455176 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3a347810-558d-4c3d-b673-9f686a2000bf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:01.456711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3a347810-558d-4c3d-b673-9f686a2000bf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:01.457845 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3a347810-558d-4c3d-b673-9f686a2000bf tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.172331 Jun 22 18:47:01.458395 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 517/993] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:47:01 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:47:02.405412 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-da189ccd-01b8-41f5-8849-27333ba55c62 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:02.406019 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-da189ccd-01b8-41f5-8849-27333ba55c62 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:02.412511 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-da189ccd-01b8-41f5-8849-27333ba55c62 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:02.412951 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-da189ccd-01b8-41f5-8849-27333ba55c62 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:02.413702 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-da189ccd-01b8-41f5-8849-27333ba55c62 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:02.414131 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-da189ccd-01b8-41f5-8849-27333ba55c62 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:02.475720 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-da189ccd-01b8-41f5-8849-27333ba55c62 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:02.476463 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-179bedb6-d3dc-4762-99ec-7c0dcd53bf4f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:02.477098 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-179bedb6-d3dc-4762-99ec-7c0dcd53bf4f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:02.484675 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-da189ccd-01b8-41f5-8849-27333ba55c62 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1214 microversion: 2.1 time: 0.083663 Jun 22 18:47:02.485042 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-179bedb6-d3dc-4762-99ec-7c0dcd53bf4f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:02.485541 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 477/994] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:02 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:02.485664 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-179bedb6-d3dc-4762-99ec-7c0dcd53bf4f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:02.486260 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-179bedb6-d3dc-4762-99ec-7c0dcd53bf4f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:02.486694 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-179bedb6-d3dc-4762-99ec-7c0dcd53bf4f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:02.619620 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-179bedb6-d3dc-4762-99ec-7c0dcd53bf4f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:02.629063 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-179bedb6-d3dc-4762-99ec-7c0dcd53bf4f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:02.630574 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-179bedb6-d3dc-4762-99ec-7c0dcd53bf4f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:02.631723 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-179bedb6-d3dc-4762-99ec-7c0dcd53bf4f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.159561 Jun 22 18:47:02.632303 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 518/995] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:47:02 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:47:02.775645 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-153711265", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2107367893", "security_groups": [{"name": "tempest-secgroup-smoke-1212979075"}], "block_device_mapping_v2": [{"uuid": "f6fee324-70b9-4174-9158-0a0d3d6b6b2c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd7ae770-155c-4c8d-a4ad-fa877423fa7d"}]}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:47:02.889834 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.network.neutron [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] validate_networks() for [('fd7ae770-155c-4c8d-a4ad-fa877423fa7d', None, None, None, None, None)] {{(pid=129743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:47:03.263961 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Flavor limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:47:03.264468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Image limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:47:03.264936 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Flavor pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:47:03.265363 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Image pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:47:03.265766 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:47:03.274397 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:03.274836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:03.275623 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:03.276082 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:03.292224 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Getting quotas for project 49c7f224d0374125ae22f576e8757f29. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:47:03.296462 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Getting quotas for user 00cfbc965d934d6db28f41f8082eb5ef and project 49c7f224d0374125ae22f576e8757f29. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:47:03.355184 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Going to run 1 instances... {{(pid=129743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:47:03.357257 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f6fee324-70b9-4174-9158-0a0d3d6b6b2c',volume_size=None,volume_type=None)] {{(pid=129743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:47:03.489018 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e6e2cd03-73ab-44c5-90c9-68c9e315c18e tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.716923 Jun 22 18:47:03.495034 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 478/996] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:47:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:47:03.501748 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5b3f0154-ff0d-43d3-8cda-62508ede11b0 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:03.502252 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-64316b46-008b-4827-a6c9-058abb5ab04d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:03.502374 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5b3f0154-ff0d-43d3-8cda-62508ede11b0 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:03.502461 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-64316b46-008b-4827-a6c9-058abb5ab04d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:03.508822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-64316b46-008b-4827-a6c9-058abb5ab04d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:03.509267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-64316b46-008b-4827-a6c9-058abb5ab04d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:03.510029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-64316b46-008b-4827-a6c9-058abb5ab04d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:03.510456 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-64316b46-008b-4827-a6c9-058abb5ab04d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:03.571290 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5b3f0154-ff0d-43d3-8cda-62508ede11b0 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:03.579737 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5b3f0154-ff0d-43d3-8cda-62508ede11b0 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1094 microversion: 2.1 time: 0.082689 Jun 22 18:47:03.580348 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 519/997] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:03 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:03.585441 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-64316b46-008b-4827-a6c9-058abb5ab04d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:03.595179 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-64316b46-008b-4827-a6c9-058abb5ab04d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1214 microversion: 2.1 time: 0.098157 Jun 22 18:47:03.595749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 479/998] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:03 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:03.650168 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-17fc4485-80a1-4636-8a53-449f95a42cb8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:03.650772 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-17fc4485-80a1-4636-8a53-449f95a42cb8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:03.657686 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-17fc4485-80a1-4636-8a53-449f95a42cb8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:03.658139 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-17fc4485-80a1-4636-8a53-449f95a42cb8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:03.658906 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-17fc4485-80a1-4636-8a53-449f95a42cb8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:03.659335 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-17fc4485-80a1-4636-8a53-449f95a42cb8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:03.795468 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-17fc4485-80a1-4636-8a53-449f95a42cb8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:03.803801 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-17fc4485-80a1-4636-8a53-449f95a42cb8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:03.805511 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-17fc4485-80a1-4636-8a53-449f95a42cb8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:03.806539 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-17fc4485-80a1-4636-8a53-449f95a42cb8 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.160198 Jun 22 18:47:03.807087 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 520/999] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:47:03 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:47:04.598194 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a064ec32-15e4-4144-8f09-9a38dd60d7c5 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:04.599611 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a064ec32-15e4-4144-8f09-9a38dd60d7c5 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:04.611621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c65b269a-f190-43bd-a968-8518da254ade tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:04.613084 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c65b269a-f190-43bd-a968-8518da254ade tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:04.616939 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a064ec32-15e4-4144-8f09-9a38dd60d7c5 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:04.617373 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a064ec32-15e4-4144-8f09-9a38dd60d7c5 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:04.618210 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a064ec32-15e4-4144-8f09-9a38dd60d7c5 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:04.619332 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a064ec32-15e4-4144-8f09-9a38dd60d7c5 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:04.619908 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c65b269a-f190-43bd-a968-8518da254ade tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:04.620355 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c65b269a-f190-43bd-a968-8518da254ade tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:04.621120 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c65b269a-f190-43bd-a968-8518da254ade tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:04.621688 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c65b269a-f190-43bd-a968-8518da254ade tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:04.734996 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a064ec32-15e4-4144-8f09-9a38dd60d7c5 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:04.746937 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a064ec32-15e4-4144-8f09-9a38dd60d7c5 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1136 microversion: 2.1 time: 0.151870 Jun 22 18:47:04.748339 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 480/1000] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:04 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1136 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:04.752493 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c65b269a-f190-43bd-a968-8518da254ade tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:04.772825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c65b269a-f190-43bd-a968-8518da254ade tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1270 microversion: 2.1 time: 0.165780 Jun 22 18:47:04.775166 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 521/1001] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:04 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:47:04.827351 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a6d16ff1-b465-469b-9ebf-59f705de4c78 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:04.827972 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a6d16ff1-b465-469b-9ebf-59f705de4c78 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:04.834037 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6d16ff1-b465-469b-9ebf-59f705de4c78 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:04.834475 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6d16ff1-b465-469b-9ebf-59f705de4c78 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:04.835231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6d16ff1-b465-469b-9ebf-59f705de4c78 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:04.835660 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6d16ff1-b465-469b-9ebf-59f705de4c78 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:04.965509 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a6d16ff1-b465-469b-9ebf-59f705de4c78 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:04.974614 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a6d16ff1-b465-469b-9ebf-59f705de4c78 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:04.976167 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a6d16ff1-b465-469b-9ebf-59f705de4c78 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:04.977337 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a6d16ff1-b465-469b-9ebf-59f705de4c78 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.154497 Jun 22 18:47:04.978454 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 481/1002] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:47:04 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:47:05.768311 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-af836df5-9a50-46de-af76-1f4675aa5979 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:05.770378 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-af836df5-9a50-46de-af76-1f4675aa5979 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:05.777705 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-af836df5-9a50-46de-af76-1f4675aa5979 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:05.778195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-af836df5-9a50-46de-af76-1f4675aa5979 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:05.778960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-af836df5-9a50-46de-af76-1f4675aa5979 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:05.779896 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-af836df5-9a50-46de-af76-1f4675aa5979 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:05.795952 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5ac3305a-570a-41cd-a1a3-fc0e80f128fa tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:05.796830 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5ac3305a-570a-41cd-a1a3-fc0e80f128fa tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:05.806748 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5ac3305a-570a-41cd-a1a3-fc0e80f128fa tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:05.807501 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5ac3305a-570a-41cd-a1a3-fc0e80f128fa tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:05.808780 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5ac3305a-570a-41cd-a1a3-fc0e80f128fa tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:05.809446 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5ac3305a-570a-41cd-a1a3-fc0e80f128fa tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:05.848222 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-af836df5-9a50-46de-af76-1f4675aa5979 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:05.851819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:05.856923 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-af836df5-9a50-46de-af76-1f4675aa5979 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1210 microversion: 2.1 time: 0.094412 Jun 22 18:47:05.858497 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 522/1003] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:05 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:05.930952 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5ac3305a-570a-41cd-a1a3-fc0e80f128fa tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:05.943080 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5ac3305a-570a-41cd-a1a3-fc0e80f128fa tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1276 microversion: 2.1 time: 0.154357 Jun 22 18:47:05.954915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 482/1004] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:05 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:05.996705 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-02d70f23-c95b-46e0-8fdf-d49b69f80d91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:05.997593 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-02d70f23-c95b-46e0-8fdf-d49b69f80d91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:06.007107 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-02d70f23-c95b-46e0-8fdf-d49b69f80d91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:06.007562 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-02d70f23-c95b-46e0-8fdf-d49b69f80d91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:06.008387 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-02d70f23-c95b-46e0-8fdf-d49b69f80d91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:06.008909 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-02d70f23-c95b-46e0-8fdf-d49b69f80d91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:06.175720 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-02d70f23-c95b-46e0-8fdf-d49b69f80d91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:06.184089 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-02d70f23-c95b-46e0-8fdf-d49b69f80d91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:06.186252 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-02d70f23-c95b-46e0-8fdf-d49b69f80d91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:06.187175 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-02d70f23-c95b-46e0-8fdf-d49b69f80d91 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.194973 Jun 22 18:47:06.187721 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 523/1005] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:47:05 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:47:06.876243 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-df2d9c27-7587-4a1d-90c6-0f6700993c6a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:06.876979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-df2d9c27-7587-4a1d-90c6-0f6700993c6a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:06.884068 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-df2d9c27-7587-4a1d-90c6-0f6700993c6a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:06.884635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-df2d9c27-7587-4a1d-90c6-0f6700993c6a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:06.889549 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-df2d9c27-7587-4a1d-90c6-0f6700993c6a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:06.890078 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-df2d9c27-7587-4a1d-90c6-0f6700993c6a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:06.960711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-89aeb8e2-5ce0-4dee-bcf2-ea4819fbe05a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:06.961423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-89aeb8e2-5ce0-4dee-bcf2-ea4819fbe05a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:06.969411 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-89aeb8e2-5ce0-4dee-bcf2-ea4819fbe05a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:06.970205 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-89aeb8e2-5ce0-4dee-bcf2-ea4819fbe05a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:06.971059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-89aeb8e2-5ce0-4dee-bcf2-ea4819fbe05a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:06.971568 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-89aeb8e2-5ce0-4dee-bcf2-ea4819fbe05a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:07.119402 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-89aeb8e2-5ce0-4dee-bcf2-ea4819fbe05a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:07.129809 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-89aeb8e2-5ce0-4dee-bcf2-ea4819fbe05a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1318 microversion: 2.1 time: 0.172877 Jun 22 18:47:07.130502 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 524/1006] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:06 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:47:07.206280 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-77af3dc7-aa7a-404c-a2f6-623803e9bff1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:07.206925 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-77af3dc7-aa7a-404c-a2f6-623803e9bff1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:07.213335 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-77af3dc7-aa7a-404c-a2f6-623803e9bff1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:07.213793 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-77af3dc7-aa7a-404c-a2f6-623803e9bff1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:07.214579 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-77af3dc7-aa7a-404c-a2f6-623803e9bff1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:07.215014 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-77af3dc7-aa7a-404c-a2f6-623803e9bff1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:07.357809 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-77af3dc7-aa7a-404c-a2f6-623803e9bff1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:07.365837 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-77af3dc7-aa7a-404c-a2f6-623803e9bff1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:07.367571 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-77af3dc7-aa7a-404c-a2f6-623803e9bff1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:07.368751 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-77af3dc7-aa7a-404c-a2f6-623803e9bff1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.166650 Jun 22 18:47:07.369308 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 525/1007] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:47:07 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:47:07.425378 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-df2d9c27-7587-4a1d-90c6-0f6700993c6a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:07.433237 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-df2d9c27-7587-4a1d-90c6-0f6700993c6a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1266 microversion: 2.1 time: 0.561703 Jun 22 18:47:07.433820 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 483/1008] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:06 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1266 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:07.489093 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-60791f89-00b6-4be7-bf8c-2f72a053fcf8 req-ef16766f-e3df-4d6b-845f-4fd067c05708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63daf967-ba4f-4773-92e1-ac70bc58330a", "name": "network-vif-plugged", "status": "completed", "tag": "d6614812-103b-4720-9cea-4cef6882458e"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:47:07.499434 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-60791f89-00b6-4be7-bf8c-2f72a053fcf8 req-ef16766f-e3df-4d6b-845f-4fd067c05708 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:07.500007 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-60791f89-00b6-4be7-bf8c-2f72a053fcf8 req-ef16766f-e3df-4d6b-845f-4fd067c05708 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:07.514842 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-60791f89-00b6-4be7-bf8c-2f72a053fcf8 req-ef16766f-e3df-4d6b-845f-4fd067c05708 service nova] Creating event network-vif-plugged:d6614812-103b-4720-9cea-4cef6882458e for instance 63daf967-ba4f-4773-92e1-ac70bc58330a on hv-cinder-81268 Jun 22 18:47:07.520912 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-60791f89-00b6-4be7-bf8c-2f72a053fcf8 req-ef16766f-e3df-4d6b-845f-4fd067c05708 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035284 Jun 22 18:47:07.522080 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 526/1009] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:47:08.148737 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ffac0ad3-1fea-4f3a-84be-40d762ea71ed tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:08.150121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ffac0ad3-1fea-4f3a-84be-40d762ea71ed tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:08.157681 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ffac0ad3-1fea-4f3a-84be-40d762ea71ed tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:08.158366 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ffac0ad3-1fea-4f3a-84be-40d762ea71ed tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:08.159214 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ffac0ad3-1fea-4f3a-84be-40d762ea71ed tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:08.159748 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ffac0ad3-1fea-4f3a-84be-40d762ea71ed tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:08.389105 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-dd40ca52-e0b9-4c1a-bf9b-fc23c9e3c560 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:08.389853 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-dd40ca52-e0b9-4c1a-bf9b-fc23c9e3c560 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:08.396746 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd40ca52-e0b9-4c1a-bf9b-fc23c9e3c560 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:08.397190 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd40ca52-e0b9-4c1a-bf9b-fc23c9e3c560 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:08.397954 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd40ca52-e0b9-4c1a-bf9b-fc23c9e3c560 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:08.398384 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dd40ca52-e0b9-4c1a-bf9b-fc23c9e3c560 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:08.423175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ffac0ad3-1fea-4f3a-84be-40d762ea71ed tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:08.431428 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ffac0ad3-1fea-4f3a-84be-40d762ea71ed tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1318 microversion: 2.1 time: 0.286653 Jun 22 18:47:08.432434 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 484/1010] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:08 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:47:08.452613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a1dda5c9-c9fd-4aaa-80b9-137423c23e80 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:08.453749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a1dda5c9-c9fd-4aaa-80b9-137423c23e80 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:08.461040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a1dda5c9-c9fd-4aaa-80b9-137423c23e80 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:08.461493 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a1dda5c9-c9fd-4aaa-80b9-137423c23e80 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:08.462282 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a1dda5c9-c9fd-4aaa-80b9-137423c23e80 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:08.462710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a1dda5c9-c9fd-4aaa-80b9-137423c23e80 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:08.551426 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dd40ca52-e0b9-4c1a-bf9b-fc23c9e3c560 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:08.561637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dd40ca52-e0b9-4c1a-bf9b-fc23c9e3c560 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:08.563081 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dd40ca52-e0b9-4c1a-bf9b-fc23c9e3c560 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:08.564263 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-dd40ca52-e0b9-4c1a-bf9b-fc23c9e3c560 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.179913 Jun 22 18:47:08.564818 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 527/1011] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:47:08 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:47:08.574931 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-f1d3a49c-a00b-4487-ae44-86d38c6a0b25 req-49bccead-426e-4793-81b1-33e9d1ed5567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3394e35e-0ffa-41fc-bdcb-48f8cb74e652", "tag": "ac7871f8-57e5-4566-b2f0-384d09016ea0"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:47:08.585702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-f1d3a49c-a00b-4487-ae44-86d38c6a0b25 req-49bccead-426e-4793-81b1-33e9d1ed5567 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:08.586242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-f1d3a49c-a00b-4487-ae44-86d38c6a0b25 req-49bccead-426e-4793-81b1-33e9d1ed5567 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:08.600644 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-f1d3a49c-a00b-4487-ae44-86d38c6a0b25 req-49bccead-426e-4793-81b1-33e9d1ed5567 service nova] Creating event network-changed:ac7871f8-57e5-4566-b2f0-384d09016ea0 for instance 3394e35e-0ffa-41fc-bdcb-48f8cb74e652 on hv-cinder-81268 Jun 22 18:47:08.605694 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-f1d3a49c-a00b-4487-ae44-86d38c6a0b25 req-49bccead-426e-4793-81b1-33e9d1ed5567 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036597 Jun 22 18:47:08.607711 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 528/1012] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:47:08.687487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a1dda5c9-c9fd-4aaa-80b9-137423c23e80 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:08.695434 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a1dda5c9-c9fd-4aaa-80b9-137423c23e80 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1266 microversion: 2.1 time: 0.247970 Jun 22 18:47:08.696165 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 485/1013] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:08 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:09.450049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5123c144-fc6e-469e-9bf5-aa795bf779df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:09.450743 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5123c144-fc6e-469e-9bf5-aa795bf779df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:09.456966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5123c144-fc6e-469e-9bf5-aa795bf779df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:09.457410 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5123c144-fc6e-469e-9bf5-aa795bf779df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:09.458158 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5123c144-fc6e-469e-9bf5-aa795bf779df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:09.458586 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5123c144-fc6e-469e-9bf5-aa795bf779df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:09.582548 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-fa1afff4-fcc4-403d-803a-dabd90c515a4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:09.583161 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-fa1afff4-fcc4-403d-803a-dabd90c515a4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:09.590089 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fa1afff4-fcc4-403d-803a-dabd90c515a4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:09.590531 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fa1afff4-fcc4-403d-803a-dabd90c515a4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:09.592003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fa1afff4-fcc4-403d-803a-dabd90c515a4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:09.592555 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fa1afff4-fcc4-403d-803a-dabd90c515a4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:09.595509 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:09.743062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-fa1afff4-fcc4-403d-803a-dabd90c515a4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:09.758860 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-fa1afff4-fcc4-403d-803a-dabd90c515a4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:09.760428 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-fa1afff4-fcc4-403d-803a-dabd90c515a4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:09.761620 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-fa1afff4-fcc4-403d-803a-dabd90c515a4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.183116 Jun 22 18:47:09.772364 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 486/1014] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:47:09 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:47:09.772364 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-cb6a63d0-ac6c-492c-bdd8-834e641e9742 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:09.772364 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-cb6a63d0-ac6c-492c-bdd8-834e641e9742 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:09.775703 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cb6a63d0-ac6c-492c-bdd8-834e641e9742 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:09.776515 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cb6a63d0-ac6c-492c-bdd8-834e641e9742 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:09.777469 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cb6a63d0-ac6c-492c-bdd8-834e641e9742 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:09.778046 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cb6a63d0-ac6c-492c-bdd8-834e641e9742 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:09.823080 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5123c144-fc6e-469e-9bf5-aa795bf779df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:09.830810 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5123c144-fc6e-469e-9bf5-aa795bf779df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1318 microversion: 2.1 time: 0.385445 Jun 22 18:47:09.832388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 529/1015] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:09 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:10.069539 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cb6a63d0-ac6c-492c-bdd8-834e641e9742 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:10.078746 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-cb6a63d0-ac6c-492c-bdd8-834e641e9742 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1266 microversion: 2.1 time: 0.313979 Jun 22 18:47:10.079320 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 487/1016] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:09 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1266 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:10.622041 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-5fa00a8a-1e07-4f0e-a1cc-8de323b5fc87 req-f8944437-edf7-4f7b-9cd8-126084eaada2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb", "tag": "1f2bbc0f-6456-4502-a10e-356c766c7742"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:47:10.631410 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-5fa00a8a-1e07-4f0e-a1cc-8de323b5fc87 req-f8944437-edf7-4f7b-9cd8-126084eaada2 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:10.631872 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-5fa00a8a-1e07-4f0e-a1cc-8de323b5fc87 req-f8944437-edf7-4f7b-9cd8-126084eaada2 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:10.642606 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-5fa00a8a-1e07-4f0e-a1cc-8de323b5fc87 req-f8944437-edf7-4f7b-9cd8-126084eaada2 service nova] Creating event network-changed:1f2bbc0f-6456-4502-a10e-356c766c7742 for instance c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb on hv-cinder-81268 Jun 22 18:47:10.647288 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-5fa00a8a-1e07-4f0e-a1cc-8de323b5fc87 req-f8944437-edf7-4f7b-9cd8-126084eaada2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028997 Jun 22 18:47:10.647871 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 530/1017] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:47:10.780105 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-71d5c1f8-723f-4f37-b364-2836ce77937f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:10.780699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-71d5c1f8-723f-4f37-b364-2836ce77937f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:10.787079 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71d5c1f8-723f-4f37-b364-2836ce77937f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:10.787515 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71d5c1f8-723f-4f37-b364-2836ce77937f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:10.788298 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71d5c1f8-723f-4f37-b364-2836ce77937f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:10.788727 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71d5c1f8-723f-4f37-b364-2836ce77937f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:10.848767 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8e6d0d31-6104-48d5-80db-ef0df2d78aa9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:10.849482 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8e6d0d31-6104-48d5-80db-ef0df2d78aa9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:10.855859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8e6d0d31-6104-48d5-80db-ef0df2d78aa9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:10.856308 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8e6d0d31-6104-48d5-80db-ef0df2d78aa9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:10.857734 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8e6d0d31-6104-48d5-80db-ef0df2d78aa9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:10.858202 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8e6d0d31-6104-48d5-80db-ef0df2d78aa9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:10.923619 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-71d5c1f8-723f-4f37-b364-2836ce77937f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:10.931592 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-71d5c1f8-723f-4f37-b364-2836ce77937f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:10.933140 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-71d5c1f8-723f-4f37-b364-2836ce77937f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:10.934284 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-71d5c1f8-723f-4f37-b364-2836ce77937f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1733 microversion: 2.20 time: 0.158203 Jun 22 18:47:10.934847 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 488/1018] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:47:10 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:47:10.987500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8e6d0d31-6104-48d5-80db-ef0df2d78aa9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:10.994926 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8e6d0d31-6104-48d5-80db-ef0df2d78aa9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1318 microversion: 2.1 time: 0.150331 Jun 22 18:47:10.995484 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 531/1019] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:10 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:47:11.096458 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-57d3b273-7e5c-4bfa-a203-4c35066288e9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:11.097064 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-57d3b273-7e5c-4bfa-a203-4c35066288e9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:11.103069 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-57d3b273-7e5c-4bfa-a203-4c35066288e9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:11.103516 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-57d3b273-7e5c-4bfa-a203-4c35066288e9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:11.104307 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-57d3b273-7e5c-4bfa-a203-4c35066288e9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:11.104740 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-57d3b273-7e5c-4bfa-a203-4c35066288e9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:11.434121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-57d3b273-7e5c-4bfa-a203-4c35066288e9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:11.442436 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-57d3b273-7e5c-4bfa-a203-4c35066288e9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1266 microversion: 2.1 time: 0.350056 Jun 22 18:47:11.442997 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 489/1020] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:11 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1266 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:11.953314 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5c035f0a-0f95-4d21-ace2-be74ceddfa09 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:11.953910 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5c035f0a-0f95-4d21-ace2-be74ceddfa09 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:11.960364 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5c035f0a-0f95-4d21-ace2-be74ceddfa09 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:11.960808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5c035f0a-0f95-4d21-ace2-be74ceddfa09 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:11.961561 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5c035f0a-0f95-4d21-ace2-be74ceddfa09 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:11.961994 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5c035f0a-0f95-4d21-ace2-be74ceddfa09 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:12.012264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7b8e2d49-f42e-450d-be01-5b7c245560dc tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:12.012869 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7b8e2d49-f42e-450d-be01-5b7c245560dc tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:12.019531 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7b8e2d49-f42e-450d-be01-5b7c245560dc tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:12.020012 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7b8e2d49-f42e-450d-be01-5b7c245560dc tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:12.020842 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7b8e2d49-f42e-450d-be01-5b7c245560dc tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:12.021279 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7b8e2d49-f42e-450d-be01-5b7c245560dc tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:12.094985 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5c035f0a-0f95-4d21-ace2-be74ceddfa09 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:12.103141 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5c035f0a-0f95-4d21-ace2-be74ceddfa09 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:12.104579 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5c035f0a-0f95-4d21-ace2-be74ceddfa09 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:12.105837 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5c035f0a-0f95-4d21-ace2-be74ceddfa09 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1720 microversion: 2.20 time: 0.156607 Jun 22 18:47:12.106393 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 532/1021] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:47:11 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:47:12.154544 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7b8e2d49-f42e-450d-be01-5b7c245560dc tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:12.161962 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7b8e2d49-f42e-450d-be01-5b7c245560dc tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1318 microversion: 2.1 time: 0.153492 Jun 22 18:47:12.162518 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 490/1022] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:12 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:47:12.458483 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-dbbc3d9e-54ef-41ed-aacf-9332016108bc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:12.459081 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-dbbc3d9e-54ef-41ed-aacf-9332016108bc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:12.465098 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dbbc3d9e-54ef-41ed-aacf-9332016108bc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:12.465566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dbbc3d9e-54ef-41ed-aacf-9332016108bc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:12.466922 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dbbc3d9e-54ef-41ed-aacf-9332016108bc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:12.467350 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dbbc3d9e-54ef-41ed-aacf-9332016108bc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:12.594537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dbbc3d9e-54ef-41ed-aacf-9332016108bc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:12.602009 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-dbbc3d9e-54ef-41ed-aacf-9332016108bc tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1266 microversion: 2.1 time: 0.147415 Jun 22 18:47:12.602565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 533/1023] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:12 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:13.178821 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-757ee341-ea39-4cfd-89c9-4209cfb91ff0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:13.179419 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-757ee341-ea39-4cfd-89c9-4209cfb91ff0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:13.181923 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:13.187568 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-757ee341-ea39-4cfd-89c9-4209cfb91ff0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:13.188044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-757ee341-ea39-4cfd-89c9-4209cfb91ff0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:13.188803 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-757ee341-ea39-4cfd-89c9-4209cfb91ff0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:13.189235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-757ee341-ea39-4cfd-89c9-4209cfb91ff0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:13.282928 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=4 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:13.302805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=14 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:13.322560 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-757ee341-ea39-4cfd-89c9-4209cfb91ff0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:13.330635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-757ee341-ea39-4cfd-89c9-4209cfb91ff0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1318 microversion: 2.1 time: 0.155925 Jun 22 18:47:13.331208 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 491/1024] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:13 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:13.618444 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8242aff4-45ae-4469-ba74-e8e4a4c411a0 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:13.619043 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8242aff4-45ae-4469-ba74-e8e4a4c411a0 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:13.621481 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:13.628197 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8242aff4-45ae-4469-ba74-e8e4a4c411a0 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:13.628639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8242aff4-45ae-4469-ba74-e8e4a4c411a0 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:13.629417 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8242aff4-45ae-4469-ba74-e8e4a4c411a0 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:13.629843 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8242aff4-45ae-4469-ba74-e8e4a4c411a0 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:13.758514 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8242aff4-45ae-4469-ba74-e8e4a4c411a0 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:13.766110 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8242aff4-45ae-4469-ba74-e8e4a4c411a0 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1266 microversion: 2.1 time: 0.151483 Jun 22 18:47:13.766670 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 534/1025] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:13 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:14.349060 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-60478e63-6d8d-4d47-89ad-cc237b554c26 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:14.349585 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-60478e63-6d8d-4d47-89ad-cc237b554c26 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:14.356106 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-60478e63-6d8d-4d47-89ad-cc237b554c26 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:14.356549 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-60478e63-6d8d-4d47-89ad-cc237b554c26 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:14.357881 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-60478e63-6d8d-4d47-89ad-cc237b554c26 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:14.358314 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-60478e63-6d8d-4d47-89ad-cc237b554c26 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:14.487288 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-60478e63-6d8d-4d47-89ad-cc237b554c26 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:14.494742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-60478e63-6d8d-4d47-89ad-cc237b554c26 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1318 microversion: 2.1 time: 0.149715 Jun 22 18:47:14.495308 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 492/1026] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:14 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:47:14.782768 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6bf79803-8216-4b76-b264-cd9981c6984b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:14.783368 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6bf79803-8216-4b76-b264-cd9981c6984b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:14.785758 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=60 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:14.791727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6bf79803-8216-4b76-b264-cd9981c6984b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:14.792310 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6bf79803-8216-4b76-b264-cd9981c6984b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:14.793110 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6bf79803-8216-4b76-b264-cd9981c6984b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:14.793567 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6bf79803-8216-4b76-b264-cd9981c6984b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:14.937132 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6bf79803-8216-4b76-b264-cd9981c6984b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:14.944774 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6bf79803-8216-4b76-b264-cd9981c6984b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1266 microversion: 2.1 time: 0.165875 Jun 22 18:47:14.945333 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 535/1027] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:14 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:15.512449 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-747bbb05-638d-4849-b641-ab6c8372e1a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:15.513082 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-747bbb05-638d-4849-b641-ab6c8372e1a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:15.519494 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-747bbb05-638d-4849-b641-ab6c8372e1a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:15.519978 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-747bbb05-638d-4849-b641-ab6c8372e1a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:15.520741 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-747bbb05-638d-4849-b641-ab6c8372e1a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:15.521282 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-747bbb05-638d-4849-b641-ab6c8372e1a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:15.653219 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-747bbb05-638d-4849-b641-ab6c8372e1a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:15.661180 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-747bbb05-638d-4849-b641-ab6c8372e1a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1318 microversion: 2.1 time: 0.152596 Jun 22 18:47:15.661745 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 493/1028] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:15 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:15.961804 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cc5e553b-2447-4a67-bf3c-b2940b6adb2f tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:15.962432 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cc5e553b-2447-4a67-bf3c-b2940b6adb2f tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:15.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc5e553b-2447-4a67-bf3c-b2940b6adb2f tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:15.970146 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc5e553b-2447-4a67-bf3c-b2940b6adb2f tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:15.970907 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc5e553b-2447-4a67-bf3c-b2940b6adb2f tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:15.971339 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cc5e553b-2447-4a67-bf3c-b2940b6adb2f tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:16.108029 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cc5e553b-2447-4a67-bf3c-b2940b6adb2f tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:16.115929 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cc5e553b-2447-4a67-bf3c-b2940b6adb2f tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1266 microversion: 2.1 time: 0.158262 Jun 22 18:47:16.116508 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 536/1029] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:15 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:16.678307 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-fafba3ac-d27b-47a1-8e8c-4cee1765b592 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:16.678927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-fafba3ac-d27b-47a1-8e8c-4cee1765b592 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:16.686018 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fafba3ac-d27b-47a1-8e8c-4cee1765b592 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:16.686412 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fafba3ac-d27b-47a1-8e8c-4cee1765b592 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:16.687156 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fafba3ac-d27b-47a1-8e8c-4cee1765b592 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:16.687582 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fafba3ac-d27b-47a1-8e8c-4cee1765b592 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:16.815822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-fafba3ac-d27b-47a1-8e8c-4cee1765b592 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:16.823120 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-fafba3ac-d27b-47a1-8e8c-4cee1765b592 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1318 microversion: 2.1 time: 0.148718 Jun 22 18:47:16.823679 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 494/1030] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:16 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:17.132810 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3839f4c3-04c7-4044-a446-a5b5fec76641 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:17.133406 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-3839f4c3-04c7-4044-a446-a5b5fec76641 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:17.140636 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3839f4c3-04c7-4044-a446-a5b5fec76641 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:17.141069 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3839f4c3-04c7-4044-a446-a5b5fec76641 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:17.141832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3839f4c3-04c7-4044-a446-a5b5fec76641 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:17.142257 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-3839f4c3-04c7-4044-a446-a5b5fec76641 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:17.278681 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-3839f4c3-04c7-4044-a446-a5b5fec76641 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:17.286088 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3839f4c3-04c7-4044-a446-a5b5fec76641 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1266 microversion: 2.1 time: 0.157131 Jun 22 18:47:17.286641 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 537/1031] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:17 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:17.738793 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-672a2af9-d34d-4e54-9971-87582025a0c2 req-4f916089-2992-4a99-879a-a922e93eabbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3394e35e-0ffa-41fc-bdcb-48f8cb74e652", "name": "network-vif-plugged", "status": "completed", "tag": "ac7871f8-57e5-4566-b2f0-384d09016ea0"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:47:17.747823 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-672a2af9-d34d-4e54-9971-87582025a0c2 req-4f916089-2992-4a99-879a-a922e93eabbc service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:17.748531 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-672a2af9-d34d-4e54-9971-87582025a0c2 req-4f916089-2992-4a99-879a-a922e93eabbc service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:17.765426 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-672a2af9-d34d-4e54-9971-87582025a0c2 req-4f916089-2992-4a99-879a-a922e93eabbc service nova] Creating event network-vif-plugged:ac7871f8-57e5-4566-b2f0-384d09016ea0 for instance 3394e35e-0ffa-41fc-bdcb-48f8cb74e652 on hv-cinder-81268 Jun 22 18:47:17.774839 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-672a2af9-d34d-4e54-9971-87582025a0c2 req-4f916089-2992-4a99-879a-a922e93eabbc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039412 Jun 22 18:47:17.775453 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 495/1032] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:47:17.840090 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-95a561be-9551-4f09-9b7f-1ff36b23b439 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:17.840703 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-95a561be-9551-4f09-9b7f-1ff36b23b439 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:17.847214 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-95a561be-9551-4f09-9b7f-1ff36b23b439 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:17.847669 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-95a561be-9551-4f09-9b7f-1ff36b23b439 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:17.848483 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-95a561be-9551-4f09-9b7f-1ff36b23b439 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:17.848921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-95a561be-9551-4f09-9b7f-1ff36b23b439 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:17.985319 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-95a561be-9551-4f09-9b7f-1ff36b23b439 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:17.992785 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-95a561be-9551-4f09-9b7f-1ff36b23b439 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1318 microversion: 2.1 time: 0.156999 Jun 22 18:47:17.993353 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 538/1033] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:17 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:18.302914 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2c6aa16c-8ca7-4467-ad4d-0f9b9ff45f90 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:18.303717 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2c6aa16c-8ca7-4467-ad4d-0f9b9ff45f90 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:18.310245 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2c6aa16c-8ca7-4467-ad4d-0f9b9ff45f90 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:18.310691 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2c6aa16c-8ca7-4467-ad4d-0f9b9ff45f90 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:18.311459 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2c6aa16c-8ca7-4467-ad4d-0f9b9ff45f90 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:18.311911 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2c6aa16c-8ca7-4467-ad4d-0f9b9ff45f90 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:18.440788 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2c6aa16c-8ca7-4467-ad4d-0f9b9ff45f90 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:18.448227 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2c6aa16c-8ca7-4467-ad4d-0f9b9ff45f90 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1266 microversion: 2.1 time: 0.149369 Jun 22 18:47:18.448797 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 496/1034] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:18 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:19.009897 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-26aae4b7-1a93-4ec0-b002-d1ea5b53db2e tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:19.010500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-26aae4b7-1a93-4ec0-b002-d1ea5b53db2e tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:19.017156 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26aae4b7-1a93-4ec0-b002-d1ea5b53db2e tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:19.017603 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26aae4b7-1a93-4ec0-b002-d1ea5b53db2e tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:19.018361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26aae4b7-1a93-4ec0-b002-d1ea5b53db2e tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:19.018791 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-26aae4b7-1a93-4ec0-b002-d1ea5b53db2e tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:19.145712 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-26aae4b7-1a93-4ec0-b002-d1ea5b53db2e tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:19.153240 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-26aae4b7-1a93-4ec0-b002-d1ea5b53db2e tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1318 microversion: 2.1 time: 0.147233 Jun 22 18:47:19.153937 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 539/1035] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:19 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:19.465399 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-9141c7f7-c933-45cb-ba3a-2798b542a706 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:19.466614 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-9141c7f7-c933-45cb-ba3a-2798b542a706 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:19.473341 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9141c7f7-c933-45cb-ba3a-2798b542a706 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:19.473791 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9141c7f7-c933-45cb-ba3a-2798b542a706 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:19.474577 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9141c7f7-c933-45cb-ba3a-2798b542a706 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:19.475003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9141c7f7-c933-45cb-ba3a-2798b542a706 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:19.789518 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-b04817c3-35ba-4606-8abe-2d1f6549b3fc req-99306d3b-9737-4164-8d74-759a6a632199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb", "name": "network-vif-plugged", "status": "completed", "tag": "1f2bbc0f-6456-4502-a10e-356c766c7742"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:47:19.798746 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-b04817c3-35ba-4606-8abe-2d1f6549b3fc req-99306d3b-9737-4164-8d74-759a6a632199 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:19.808267 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-b04817c3-35ba-4606-8abe-2d1f6549b3fc req-99306d3b-9737-4164-8d74-759a6a632199 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:19.819710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-b04817c3-35ba-4606-8abe-2d1f6549b3fc req-99306d3b-9737-4164-8d74-759a6a632199 service nova] Creating event network-vif-plugged:1f2bbc0f-6456-4502-a10e-356c766c7742 for instance c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb on hv-cinder-81268 Jun 22 18:47:19.824742 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-b04817c3-35ba-4606-8abe-2d1f6549b3fc req-99306d3b-9737-4164-8d74-759a6a632199 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038920 Jun 22 18:47:19.825903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 540/1036] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:47:19.860077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-9141c7f7-c933-45cb-ba3a-2798b542a706 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:19.867544 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-9141c7f7-c933-45cb-ba3a-2798b542a706 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1266 microversion: 2.1 time: 0.406015 Jun 22 18:47:19.868137 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 497/1037] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:19 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1266 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:20.171177 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7034e18a-f6c4-43a6-afe7-6f23d3c313f3 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:20.171803 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7034e18a-f6c4-43a6-afe7-6f23d3c313f3 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:20.177987 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7034e18a-f6c4-43a6-afe7-6f23d3c313f3 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:20.178428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7034e18a-f6c4-43a6-afe7-6f23d3c313f3 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:20.179176 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7034e18a-f6c4-43a6-afe7-6f23d3c313f3 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:20.179602 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7034e18a-f6c4-43a6-afe7-6f23d3c313f3 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:20.320467 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7034e18a-f6c4-43a6-afe7-6f23d3c313f3 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:20.328484 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7034e18a-f6c4-43a6-afe7-6f23d3c313f3 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1318 microversion: 2.1 time: 0.162211 Jun 22 18:47:20.329039 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 541/1038] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:20 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:20.885005 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-0a1568e6-2617-4d58-b709-92af0a73a38b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:20.885603 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0a1568e6-2617-4d58-b709-92af0a73a38b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:20.892230 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0a1568e6-2617-4d58-b709-92af0a73a38b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:20.892676 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0a1568e6-2617-4d58-b709-92af0a73a38b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:20.893432 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0a1568e6-2617-4d58-b709-92af0a73a38b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:20.893867 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0a1568e6-2617-4d58-b709-92af0a73a38b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:21.025331 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-0a1568e6-2617-4d58-b709-92af0a73a38b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:21.033439 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-0a1568e6-2617-4d58-b709-92af0a73a38b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1266 microversion: 2.1 time: 0.152333 Jun 22 18:47:21.034011 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 498/1039] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:20 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:47:21.346175 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d49fbdc8-b074-4b8e-b910-77774d9d7580 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:21.346732 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d49fbdc8-b074-4b8e-b910-77774d9d7580 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:21.353263 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d49fbdc8-b074-4b8e-b910-77774d9d7580 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:21.353715 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d49fbdc8-b074-4b8e-b910-77774d9d7580 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:21.354512 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d49fbdc8-b074-4b8e-b910-77774d9d7580 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:21.354950 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d49fbdc8-b074-4b8e-b910-77774d9d7580 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:21.359182 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=100 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:21.485827 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d49fbdc8-b074-4b8e-b910-77774d9d7580 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:21.497639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d49fbdc8-b074-4b8e-b910-77774d9d7580 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1508 microversion: 2.1 time: 0.154672 Jun 22 18:47:21.498490 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 542/1040] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:21 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:22.050139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5a3e0158-8210-48bf-aae1-4bf91c0eddba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:22.050746 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5a3e0158-8210-48bf-aae1-4bf91c0eddba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:22.057196 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a3e0158-8210-48bf-aae1-4bf91c0eddba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:22.057636 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a3e0158-8210-48bf-aae1-4bf91c0eddba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:22.058398 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a3e0158-8210-48bf-aae1-4bf91c0eddba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:22.058823 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5a3e0158-8210-48bf-aae1-4bf91c0eddba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:22.208212 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5a3e0158-8210-48bf-aae1-4bf91c0eddba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:22.215635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5a3e0158-8210-48bf-aae1-4bf91c0eddba tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1266 microversion: 2.1 time: 0.169497 Jun 22 18:47:22.217479 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 499/1041] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:22 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:23.235027 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-337a9d72-22ea-455d-9c02-3d9933f4a72d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:23.235555 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-337a9d72-22ea-455d-9c02-3d9933f4a72d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:23.243269 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-337a9d72-22ea-455d-9c02-3d9933f4a72d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:23.243779 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-337a9d72-22ea-455d-9c02-3d9933f4a72d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:23.244605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-337a9d72-22ea-455d-9c02-3d9933f4a72d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:23.245042 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-337a9d72-22ea-455d-9c02-3d9933f4a72d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:23.384852 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-337a9d72-22ea-455d-9c02-3d9933f4a72d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:23.393029 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-337a9d72-22ea-455d-9c02-3d9933f4a72d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1453 microversion: 2.1 time: 0.162856 Jun 22 18:47:23.393582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 543/1042] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:23 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:23.409640 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-dbda0835-72b7-4e65-bd79-71678d7b9601 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:23.410301 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-dbda0835-72b7-4e65-bd79-71678d7b9601 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:23.416934 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dbda0835-72b7-4e65-bd79-71678d7b9601 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:23.417392 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dbda0835-72b7-4e65-bd79-71678d7b9601 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:23.418238 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dbda0835-72b7-4e65-bd79-71678d7b9601 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:23.418725 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dbda0835-72b7-4e65-bd79-71678d7b9601 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:23.566849 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-dbda0835-72b7-4e65-bd79-71678d7b9601 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:47:23.574504 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-dbda0835-72b7-4e65-bd79-71678d7b9601 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1453 microversion: 2.1 time: 0.168775 Jun 22 18:47:23.575168 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 500/1043] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:47:23 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:47:25.276914 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-a1f87ab0-c72e-472e-973c-daba38b314e3 req-833133b9-f9e0-42ce-8c25-1e374b13bc49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb", "tag": "1f2bbc0f-6456-4502-a10e-356c766c7742"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:47:25.287882 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-a1f87ab0-c72e-472e-973c-daba38b314e3 req-833133b9-f9e0-42ce-8c25-1e374b13bc49 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:25.288961 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-a1f87ab0-c72e-472e-973c-daba38b314e3 req-833133b9-f9e0-42ce-8c25-1e374b13bc49 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:25.301532 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-a1f87ab0-c72e-472e-973c-daba38b314e3 req-833133b9-f9e0-42ce-8c25-1e374b13bc49 service nova] Creating event network-changed:1f2bbc0f-6456-4502-a10e-356c766c7742 for instance c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb on hv-cinder-81268 Jun 22 18:47:25.306637 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-a1f87ab0-c72e-472e-973c-daba38b314e3 req-833133b9-f9e0-42ce-8c25-1e374b13bc49 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033834 Jun 22 18:47:25.307240 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 544/1044] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:47:48.175351 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-685135c5-12d1-409b-a052-26c2ae97f7df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb2c2354-4d9e-455d-8faf-be34a1479f83", "device": "/dev/sdb"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:47:48.177055 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-685135c5-12d1-409b-a052-26c2ae97f7df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:48.179305 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=19 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:48.179980 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=85 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:48.185865 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-685135c5-12d1-409b-a052-26c2ae97f7df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:48.186318 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-685135c5-12d1-409b-a052-26c2ae97f7df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:48.187092 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-685135c5-12d1-409b-a052-26c2ae97f7df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:48.187525 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-685135c5-12d1-409b-a052-26c2ae97f7df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:48.437939 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-685135c5-12d1-409b-a052-26c2ae97f7df tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "POST /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266386 Jun 22 18:47:48.438545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 501/1045] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:47:48 2022] POST /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:47:50.572778 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=19 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:50.573516 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=12 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:47:50.578453 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0d1516d0-d1a9-4045-ad44-5b90e0f67f84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:47:50.579186 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0d1516d0-d1a9-4045-ad44-5b90e0f67f84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:50.587583 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0d1516d0-d1a9-4045-ad44-5b90e0f67f84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:50.588071 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0d1516d0-d1a9-4045-ad44-5b90e0f67f84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:50.588891 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0d1516d0-d1a9-4045-ad44-5b90e0f67f84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:50.589329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0d1516d0-d1a9-4045-ad44-5b90e0f67f84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:50.613819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0d1516d0-d1a9-4045-ad44-5b90e0f67f84 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/ips" status: 200 len: 146 microversion: 2.1 time: 0.043329 Jun 22 18:47:50.614384 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 545/1046] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 18:47:50 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:47:51.958913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-de7c2205-197a-43ea-a8d4-eeff9a4e5f61 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bbc8cab-731b-4ec1-9daf-9fd1cefffa98"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:47:51.960081 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-de7c2205-197a-43ea-a8d4-eeff9a4e5f61 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:47:51.966697 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de7c2205-197a-43ea-a8d4-eeff9a4e5f61 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:51.967140 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de7c2205-197a-43ea-a8d4-eeff9a4e5f61 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:51.969099 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de7c2205-197a-43ea-a8d4-eeff9a4e5f61 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:47:51.969650 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de7c2205-197a-43ea-a8d4-eeff9a4e5f61 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:47:52.318403 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-de7c2205-197a-43ea-a8d4-eeff9a4e5f61 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "POST /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363686 Jun 22 18:47:52.319104 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 502/1047] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:47:51 2022] POST /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:02.979956 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-fcac11f8-4351-4f6a-8a4d-a12f6511156f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:02.981532 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-fcac11f8-4351-4f6a-8a4d-a12f6511156f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:02.984751 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:02.985369 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=4 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:02.989141 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fcac11f8-4351-4f6a-8a4d-a12f6511156f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:02.989622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fcac11f8-4351-4f6a-8a4d-a12f6511156f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:02.990376 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fcac11f8-4351-4f6a-8a4d-a12f6511156f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:02.990803 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fcac11f8-4351-4f6a-8a4d-a12f6511156f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:03.021371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-fcac11f8-4351-4f6a-8a4d-a12f6511156f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046934 Jun 22 18:48:03.021834 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 546/1048] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:48:02 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:03.029506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=4 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:03.030428 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:03.034601 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ddf7203e-eda5-49c0-89a6-b9b7dc2b7528 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:03.035173 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ddf7203e-eda5-49c0-89a6-b9b7dc2b7528 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:03.042348 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ddf7203e-eda5-49c0-89a6-b9b7dc2b7528 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:03.042790 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ddf7203e-eda5-49c0-89a6-b9b7dc2b7528 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:03.043544 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ddf7203e-eda5-49c0-89a6-b9b7dc2b7528 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:03.044010 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ddf7203e-eda5-49c0-89a6-b9b7dc2b7528 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:03.073646 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ddf7203e-eda5-49c0-89a6-b9b7dc2b7528 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments/9bbc8cab-731b-4ec1-9daf-9fd1cefffa98" status: 200 len: 194 microversion: 2.1 time: 0.045714 Jun 22 18:48:03.074215 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 503/1049] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Jun 22 18:48:03 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments/9bbc8cab-731b-4ec1-9daf-9fd1cefffa98 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:08.589146 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a1c9d6a1-f6dd-4165-a1e8-9bdc5c86cce4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dc2751a-1688-4a9e-b59f-c2d63169cae2"}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:48:08.590194 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a1c9d6a1-f6dd-4165-a1e8-9bdc5c86cce4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:08.597457 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a1c9d6a1-f6dd-4165-a1e8-9bdc5c86cce4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:08.597898 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a1c9d6a1-f6dd-4165-a1e8-9bdc5c86cce4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:08.598653 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a1c9d6a1-f6dd-4165-a1e8-9bdc5c86cce4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:08.599082 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a1c9d6a1-f6dd-4165-a1e8-9bdc5c86cce4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:12.115808 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a1c9d6a1-f6dd-4165-a1e8-9bdc5c86cce4 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "POST /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.530544 Jun 22 18:48:12.116475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 547/1050] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:48:08 2022] POST /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments => generated 194 bytes in 3532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:17.237521 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f5c55786-8f57-4af4-9d8f-8c1ca3a0915f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:17.238035 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f5c55786-8f57-4af4-9d8f-8c1ca3a0915f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:17.240434 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:17.241213 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=6 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:17.247504 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5c55786-8f57-4af4-9d8f-8c1ca3a0915f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:17.247974 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5c55786-8f57-4af4-9d8f-8c1ca3a0915f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:17.249507 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5c55786-8f57-4af4-9d8f-8c1ca3a0915f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:17.249937 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f5c55786-8f57-4af4-9d8f-8c1ca3a0915f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:17.335181 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.objects.instance [None req-f5c55786-8f57-4af4-9d8f-8c1ca3a0915f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lazy-loading 'services' on Instance uuid 3394e35e-0ffa-41fc-bdcb-48f8cb74e652 {{(pid=129743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:48:17.408399 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f5c55786-8f57-4af4-9d8f-8c1ca3a0915f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652/os-volume_attachments/fb2c2354-4d9e-455d-8faf-be34a1479f83" status: 202 len: 0 microversion: 2.1 time: 0.175392 Jun 22 18:48:17.409000 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 504/1051] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 18:48:17 2022] DELETE /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652/os-volume_attachments/fb2c2354-4d9e-455d-8faf-be34a1479f83 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:48:20.720183 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0ae3e0bf-7076-4343-bb62-725e1aa7508f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:20.721186 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0ae3e0bf-7076-4343-bb62-725e1aa7508f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:20.723664 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=4 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:20.729604 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0ae3e0bf-7076-4343-bb62-725e1aa7508f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:20.730063 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0ae3e0bf-7076-4343-bb62-725e1aa7508f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:20.730841 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0ae3e0bf-7076-4343-bb62-725e1aa7508f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:20.731278 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0ae3e0bf-7076-4343-bb62-725e1aa7508f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:20.769149 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0ae3e0bf-7076-4343-bb62-725e1aa7508f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053305 Jun 22 18:48:20.774195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 548/1052] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:48:20 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:20.909971 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7e09f0a3-db59-4927-8b73-a8949562686b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:20.910548 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7e09f0a3-db59-4927-8b73-a8949562686b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:20.916843 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7e09f0a3-db59-4927-8b73-a8949562686b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:20.917290 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7e09f0a3-db59-4927-8b73-a8949562686b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:20.918049 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7e09f0a3-db59-4927-8b73-a8949562686b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:20.918488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7e09f0a3-db59-4927-8b73-a8949562686b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:20.946855 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7e09f0a3-db59-4927-8b73-a8949562686b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments/9bbc8cab-731b-4ec1-9daf-9fd1cefffa98" status: 200 len: 194 microversion: 2.1 time: 0.042073 Jun 22 18:48:20.947426 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 505/1053] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Jun 22 18:48:20 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments/9bbc8cab-731b-4ec1-9daf-9fd1cefffa98 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:20.958134 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e044b3fe-ab22-4b36-93e5-b78c0daaca9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:20.958625 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e044b3fe-ab22-4b36-93e5-b78c0daaca9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:20.965233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e044b3fe-ab22-4b36-93e5-b78c0daaca9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:20.965674 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e044b3fe-ab22-4b36-93e5-b78c0daaca9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:20.966432 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e044b3fe-ab22-4b36-93e5-b78c0daaca9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:20.966864 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e044b3fe-ab22-4b36-93e5-b78c0daaca9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:21.044507 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-e044b3fe-ab22-4b36-93e5-b78c0daaca9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lazy-loading 'services' on Instance uuid 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:48:21.114524 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e044b3fe-ab22-4b36-93e5-b78c0daaca9b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments/9bbc8cab-731b-4ec1-9daf-9fd1cefffa98" status: 202 len: 0 microversion: 2.1 time: 0.160122 Jun 22 18:48:21.115168 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 549/1054] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 18:48:20 2022] DELETE /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments/9bbc8cab-731b-4ec1-9daf-9fd1cefffa98 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:48:21.735373 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a3d4b865-948e-4083-a924-e9da2fb344ba tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:21.735899 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a3d4b865-948e-4083-a924-e9da2fb344ba tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:21.742375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a3d4b865-948e-4083-a924-e9da2fb344ba tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:21.742822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a3d4b865-948e-4083-a924-e9da2fb344ba tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:21.743583 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a3d4b865-948e-4083-a924-e9da2fb344ba tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:21.744048 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a3d4b865-948e-4083-a924-e9da2fb344ba tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:21.770679 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a3d4b865-948e-4083-a924-e9da2fb344ba tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Going to try to terminate instance {{(pid=129743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:48:21.846935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a3d4b865-948e-4083-a924-e9da2fb344ba tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 204 len: 0 microversion: 2.1 time: 0.115708 Jun 22 18:48:21.847511 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 506/1055] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:48:21 2022] DELETE /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:48:21.856589 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-97f756dd-21eb-4837-a13e-f21a9e865ee8 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:21.857286 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-97f756dd-21eb-4837-a13e-f21a9e865ee8 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:21.863522 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-97f756dd-21eb-4837-a13e-f21a9e865ee8 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:21.864009 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-97f756dd-21eb-4837-a13e-f21a9e865ee8 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:21.864776 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-97f756dd-21eb-4837-a13e-f21a9e865ee8 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:21.865213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-97f756dd-21eb-4837-a13e-f21a9e865ee8 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:21.994188 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-97f756dd-21eb-4837-a13e-f21a9e865ee8 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:22.002653 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-97f756dd-21eb-4837-a13e-f21a9e865ee8 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1514 microversion: 2.1 time: 0.150600 Jun 22 18:48:22.003472 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 550/1056] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:21 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:23.020634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b0f69a0c-7ad5-4a23-919d-cd3236605d1b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:23.021324 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b0f69a0c-7ad5-4a23-919d-cd3236605d1b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:23.028060 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b0f69a0c-7ad5-4a23-919d-cd3236605d1b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:23.028451 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b0f69a0c-7ad5-4a23-919d-cd3236605d1b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:23.029212 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b0f69a0c-7ad5-4a23-919d-cd3236605d1b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:23.030561 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b0f69a0c-7ad5-4a23-919d-cd3236605d1b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:23.159480 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b0f69a0c-7ad5-4a23-919d-cd3236605d1b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:23.166890 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b0f69a0c-7ad5-4a23-919d-cd3236605d1b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1514 microversion: 2.1 time: 0.150486 Jun 22 18:48:23.167441 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 507/1057] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:23 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:24.184429 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7c53d4f2-e1c9-4c68-be6a-389ed1f4076b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:24.185035 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7c53d4f2-e1c9-4c68-be6a-389ed1f4076b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:24.192451 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7c53d4f2-e1c9-4c68-be6a-389ed1f4076b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:24.193042 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7c53d4f2-e1c9-4c68-be6a-389ed1f4076b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:24.193822 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7c53d4f2-e1c9-4c68-be6a-389ed1f4076b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:24.194266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7c53d4f2-e1c9-4c68-be6a-389ed1f4076b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:24.333096 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7c53d4f2-e1c9-4c68-be6a-389ed1f4076b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:24.340735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7c53d4f2-e1c9-4c68-be6a-389ed1f4076b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1514 microversion: 2.1 time: 0.160184 Jun 22 18:48:24.341453 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 551/1058] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:24 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:24.347800 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c7c9c06e-3724-45a0-81c3-9b7bee9041e5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:24.348456 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c7c9c06e-3724-45a0-81c3-9b7bee9041e5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:24.354476 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c7c9c06e-3724-45a0-81c3-9b7bee9041e5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:24.354918 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c7c9c06e-3724-45a0-81c3-9b7bee9041e5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:24.355676 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c7c9c06e-3724-45a0-81c3-9b7bee9041e5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:24.356133 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c7c9c06e-3724-45a0-81c3-9b7bee9041e5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:24.386353 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c7c9c06e-3724-45a0-81c3-9b7bee9041e5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments/6dc2751a-1688-4a9e-b59f-c2d63169cae2" status: 200 len: 194 microversion: 2.1 time: 0.043301 Jun 22 18:48:24.386933 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 508/1059] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Jun 22 18:48:24 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments/6dc2751a-1688-4a9e-b59f-c2d63169cae2 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:24.397080 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-086cf6a4-bcec-4d57-931c-09ea541443d2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:24.397567 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-086cf6a4-bcec-4d57-931c-09ea541443d2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:24.403577 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-086cf6a4-bcec-4d57-931c-09ea541443d2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:24.404066 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-086cf6a4-bcec-4d57-931c-09ea541443d2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:24.404958 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-086cf6a4-bcec-4d57-931c-09ea541443d2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:24.405390 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-086cf6a4-bcec-4d57-931c-09ea541443d2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:24.486990 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-086cf6a4-bcec-4d57-931c-09ea541443d2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lazy-loading 'services' on Instance uuid 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:48:24.564544 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-086cf6a4-bcec-4d57-931c-09ea541443d2 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments/6dc2751a-1688-4a9e-b59f-c2d63169cae2" status: 202 len: 0 microversion: 2.1 time: 0.171099 Jun 22 18:48:24.565546 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 552/1060] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 18:48:24 2022] DELETE /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments/6dc2751a-1688-4a9e-b59f-c2d63169cae2 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:48:24.622231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-7c4a4ec2-1814-4cd3-8982-bede1f5ae750 req-5801555f-3a9f-4ce2-8ea8-8ba530c2e880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3394e35e-0ffa-41fc-bdcb-48f8cb74e652", "name": "network-vif-deleted", "tag": "ac7871f8-57e5-4566-b2f0-384d09016ea0"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:48:24.635639 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-7c4a4ec2-1814-4cd3-8982-bede1f5ae750 req-5801555f-3a9f-4ce2-8ea8-8ba530c2e880 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:24.636476 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-7c4a4ec2-1814-4cd3-8982-bede1f5ae750 req-5801555f-3a9f-4ce2-8ea8-8ba530c2e880 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:24.651653 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-7c4a4ec2-1814-4cd3-8982-bede1f5ae750 req-5801555f-3a9f-4ce2-8ea8-8ba530c2e880 service nova] Creating event network-vif-deleted:ac7871f8-57e5-4566-b2f0-384d09016ea0 for instance 3394e35e-0ffa-41fc-bdcb-48f8cb74e652 on hv-cinder-81268 Jun 22 18:48:24.658235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-7c4a4ec2-1814-4cd3-8982-bede1f5ae750 req-5801555f-3a9f-4ce2-8ea8-8ba530c2e880 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041157 Jun 22 18:48:24.658872 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 509/1061] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:25.255279 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-03a17ddd-64c6-475b-9776-5fea5b089d5d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:25.255858 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-03a17ddd-64c6-475b-9776-5fea5b089d5d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:25.262007 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-03a17ddd-64c6-475b-9776-5fea5b089d5d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:25.262463 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-03a17ddd-64c6-475b-9776-5fea5b089d5d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:25.263214 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-03a17ddd-64c6-475b-9776-5fea5b089d5d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:25.263642 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-03a17ddd-64c6-475b-9776-5fea5b089d5d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:25.288407 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-03a17ddd-64c6-475b-9776-5fea5b089d5d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/ips" status: 200 len: 150 microversion: 2.1 time: 0.037978 Jun 22 18:48:25.288955 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 553/1062] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 18:48:25 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:48:25.357826 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f27ea1b0-edc4-4709-a9f3-9b6bb7f787bb tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:25.358685 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f27ea1b0-edc4-4709-a9f3-9b6bb7f787bb tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:25.365267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f27ea1b0-edc4-4709-a9f3-9b6bb7f787bb tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:25.365713 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f27ea1b0-edc4-4709-a9f3-9b6bb7f787bb tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:25.366504 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f27ea1b0-edc4-4709-a9f3-9b6bb7f787bb tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:25.366932 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f27ea1b0-edc4-4709-a9f3-9b6bb7f787bb tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:25.409929 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f27ea1b0-edc4-4709-a9f3-9b6bb7f787bb tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:25.410370 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f27ea1b0-edc4-4709-a9f3-9b6bb7f787bb tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:25.411136 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.objects.instance [None req-f27ea1b0-edc4-4709-a9f3-9b6bb7f787bb tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lazy-loading 'fault' on Instance uuid 3394e35e-0ffa-41fc-bdcb-48f8cb74e652 {{(pid=129743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:48:25.461895 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f27ea1b0-edc4-4709-a9f3-9b6bb7f787bb tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:25.471335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f27ea1b0-edc4-4709-a9f3-9b6bb7f787bb tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 200 len: 1308 microversion: 2.1 time: 0.118128 Jun 22 18:48:25.471981 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 510/1063] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:25 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 1308 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:25.741164 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b217214f-caf5-446a-8524-fab2b93431be tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:25.742380 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b217214f-caf5-446a-8524-fab2b93431be tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:25.748571 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b217214f-caf5-446a-8524-fab2b93431be tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:25.749129 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b217214f-caf5-446a-8524-fab2b93431be tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:25.749899 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b217214f-caf5-446a-8524-fab2b93431be tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:25.750335 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b217214f-caf5-446a-8524-fab2b93431be tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:25.781362 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b217214f-caf5-446a-8524-fab2b93431be tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043957 Jun 22 18:48:25.781897 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 554/1064] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:48:25 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 18:48:25.887766 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f8921143-cf48-4855-9a9a-e10ff08fb09f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:25.888736 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f8921143-cf48-4855-9a9a-e10ff08fb09f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:25.895598 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f8921143-cf48-4855-9a9a-e10ff08fb09f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:25.896086 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f8921143-cf48-4855-9a9a-e10ff08fb09f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:25.896843 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f8921143-cf48-4855-9a9a-e10ff08fb09f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:25.897279 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f8921143-cf48-4855-9a9a-e10ff08fb09f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:25.926762 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f8921143-cf48-4855-9a9a-e10ff08fb09f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042892 Jun 22 18:48:25.927314 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 511/1065] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:48:25 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 18:48:25.988084 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-46d0f59d-539c-4d67-8fb2-b651daf5e4a5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:25.988602 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-46d0f59d-539c-4d67-8fb2-b651daf5e4a5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:25.994518 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46d0f59d-539c-4d67-8fb2-b651daf5e4a5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:25.994966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46d0f59d-539c-4d67-8fb2-b651daf5e4a5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:25.995718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46d0f59d-539c-4d67-8fb2-b651daf5e4a5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:25.996176 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-46d0f59d-539c-4d67-8fb2-b651daf5e4a5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:26.021731 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-46d0f59d-539c-4d67-8fb2-b651daf5e4a5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Going to try to terminate instance {{(pid=129744) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:48:26.102695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-46d0f59d-539c-4d67-8fb2-b651daf5e4a5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 204 len: 0 microversion: 2.1 time: 0.117789 Jun 22 18:48:26.103887 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 555/1066] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:48:25 2022] DELETE /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:48:26.112253 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a6479e51-8241-4453-8a7b-5789b7e8906e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:26.112861 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a6479e51-8241-4453-8a7b-5789b7e8906e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:26.118886 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6479e51-8241-4453-8a7b-5789b7e8906e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:26.119311 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6479e51-8241-4453-8a7b-5789b7e8906e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:26.120095 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6479e51-8241-4453-8a7b-5789b7e8906e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:26.120535 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a6479e51-8241-4453-8a7b-5789b7e8906e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:26.253201 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a6479e51-8241-4453-8a7b-5789b7e8906e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:26.260707 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a6479e51-8241-4453-8a7b-5789b7e8906e tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1672 microversion: 2.1 time: 0.152551 Jun 22 18:48:26.261269 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 512/1067] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:26 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:26.489510 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a706bf88-da12-4a72-b583-e4960f8b4ff9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:26.490197 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a706bf88-da12-4a72-b583-e4960f8b4ff9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 3394e35e-0ffa-41fc-bdcb-48f8cb74e652] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:26.496725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a706bf88-da12-4a72-b583-e4960f8b4ff9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:26.497168 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a706bf88-da12-4a72-b583-e4960f8b4ff9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:26.497920 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a706bf88-da12-4a72-b583-e4960f8b4ff9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:26.498961 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a706bf88-da12-4a72-b583-e4960f8b4ff9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:26.512533 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-a706bf88-da12-4a72-b583-e4960f8b4ff9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] HTTP exception thrown: Instance 3394e35e-0ffa-41fc-bdcb-48f8cb74e652 could not be found. Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a706bf88-da12-4a72-b583-e4960f8b4ff9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Request method failure captured: Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 HTTP/1.1 Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2OZjSyAsoL33umvN0BEiUikyzKANjP7Ns3iNbgsCsVxpWUQNJpHNdApoPdNbw_zVBz6PezeHJrFz8FEbgwxuAkVIwfmwUjlUKSoU9uqtX9hGo-ixMeEgNxft7CnsnU0ZU06GHJhK_UYlBxhy53LNSZKVLbpLI6KjfquNdIraC10DPI Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 500e8157246e450ea87f751218856c7a Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-VolumesSnapshotTestJSON-830075092 Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:48:26.514208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:48:26.516112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_500e8157246e450ea87f751218856c7a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/500e8157246e450ea87f751218856c7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/500e8157246e450ea87f751218856c7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/500e8157246e450ea87f751218856c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:48:26.516112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-VolumesSnapshotTestJSON-830075092 Jun 22 18:48:26.516112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 500e8157246e450ea87f751218856c7a Jun 22 18:48:26.516112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-830075092 Jun 22 18:48:26.516112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-VolumesSnapshotTestJSON-830075092-project Jun 22 18:48:26.516112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:48:26.516112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:48:26.516112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 5b995c6bf02b4e50aa836324c6f3414e Jun 22 18:48:26.516112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-VolumesSnapshotTestJSON-830075092-project Jun 22 18:48:26.516112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:48:26.516112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance 3394e35e-0ffa-41fc-bdcb-48f8cb74e652 could not be found. Jun 22 18:48:26.516112 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '3394e35e-0ffa-41fc-bdcb-48f8cb74e652'} Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3394e35e-0ffa-41fc-bdcb-48f8cb74e652 could not be found. Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:48:26.517059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3394e35e-0ffa-41fc-bdcb-48f8cb74e652 could not be found. Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3394e35e-0ffa-41fc-bdcb-48f8cb74e652 could not be found. Jun 22 18:48:26.518582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:26.519996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a706bf88-da12-4a72-b583-e4960f8b4ff9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Returning 404 to user: Instance 3394e35e-0ffa-41fc-bdcb-48f8cb74e652 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:48:26.519996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a706bf88-da12-4a72-b583-e4960f8b4ff9 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652" status: 404 len: 111 microversion: 2.1 time: 0.030365 Jun 22 18:48:26.519996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 556/1068] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:26 2022] GET /compute/v2.1/servers/3394e35e-0ffa-41fc-bdcb-48f8cb74e652 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:48:26.641729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-8840dbc7-91e5-4aea-b242-f55c42a8194f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6354e859-49d1-4eee-a6d0-600ff5874a72"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:48:26.643368 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-8840dbc7-91e5-4aea-b242-f55c42a8194f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:26.650247 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8840dbc7-91e5-4aea-b242-f55c42a8194f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:26.650749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8840dbc7-91e5-4aea-b242-f55c42a8194f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:26.651571 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8840dbc7-91e5-4aea-b242-f55c42a8194f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:26.652053 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-8840dbc7-91e5-4aea-b242-f55c42a8194f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:27.278362 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-38356c32-241d-4868-afa9-08b5ef4a14d5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:27.278961 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-38356c32-241d-4868-afa9-08b5ef4a14d5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:27.285632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-38356c32-241d-4868-afa9-08b5ef4a14d5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:27.286075 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-38356c32-241d-4868-afa9-08b5ef4a14d5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:27.286829 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-38356c32-241d-4868-afa9-08b5ef4a14d5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:27.287256 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-38356c32-241d-4868-afa9-08b5ef4a14d5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:27.419955 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-38356c32-241d-4868-afa9-08b5ef4a14d5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:27.427764 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-38356c32-241d-4868-afa9-08b5ef4a14d5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1672 microversion: 2.1 time: 0.153237 Jun 22 18:48:27.428356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 557/1069] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:27 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:48:28.445361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-91f2572f-c4c7-40a3-af62-459d73cd6268 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:28.445978 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-91f2572f-c4c7-40a3-af62-459d73cd6268 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:28.452942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-91f2572f-c4c7-40a3-af62-459d73cd6268 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:28.453390 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-91f2572f-c4c7-40a3-af62-459d73cd6268 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:28.454147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-91f2572f-c4c7-40a3-af62-459d73cd6268 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:28.454581 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-91f2572f-c4c7-40a3-af62-459d73cd6268 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:28.586639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-91f2572f-c4c7-40a3-af62-459d73cd6268 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:28.594447 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-91f2572f-c4c7-40a3-af62-459d73cd6268 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1672 microversion: 2.1 time: 0.152914 Jun 22 18:48:28.595011 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 558/1070] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:28 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:48:29.611755 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-43f39f3d-0278-4fa5-8368-8e102faef99b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:29.612407 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-43f39f3d-0278-4fa5-8368-8e102faef99b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:29.618930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43f39f3d-0278-4fa5-8368-8e102faef99b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:29.619388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43f39f3d-0278-4fa5-8368-8e102faef99b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:29.620165 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43f39f3d-0278-4fa5-8368-8e102faef99b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:29.620595 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43f39f3d-0278-4fa5-8368-8e102faef99b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:29.625355 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:29.748108 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-43f39f3d-0278-4fa5-8368-8e102faef99b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:29.756425 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-43f39f3d-0278-4fa5-8368-8e102faef99b tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1672 microversion: 2.1 time: 0.148965 Jun 22 18:48:29.756985 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 559/1071] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:29 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:48:30.774248 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2e633f23-9829-427b-a772-e0ea400b54bf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:30.774881 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2e633f23-9829-427b-a772-e0ea400b54bf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:30.781593 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2e633f23-9829-427b-a772-e0ea400b54bf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:30.782044 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2e633f23-9829-427b-a772-e0ea400b54bf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:30.782822 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2e633f23-9829-427b-a772-e0ea400b54bf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:30.783240 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2e633f23-9829-427b-a772-e0ea400b54bf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:30.911467 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-2e633f23-9829-427b-a772-e0ea400b54bf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:30.918938 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2e633f23-9829-427b-a772-e0ea400b54bf tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1672 microversion: 2.1 time: 0.148560 Jun 22 18:48:30.919494 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 560/1072] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:30 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:48:31.128308 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-8840dbc7-91e5-4aea-b242-f55c42a8194f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "POST /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.491563 Jun 22 18:48:31.129075 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 513/1073] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:48:26 2022] POST /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-volume_attachments => generated 194 bytes in 4493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:48:31.936898 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-dc798bd8-e763-4908-9db8-0b36526558b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:31.937497 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-dc798bd8-e763-4908-9db8-0b36526558b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:31.944033 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dc798bd8-e763-4908-9db8-0b36526558b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:31.944475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dc798bd8-e763-4908-9db8-0b36526558b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:31.945230 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dc798bd8-e763-4908-9db8-0b36526558b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:31.945657 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dc798bd8-e763-4908-9db8-0b36526558b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:32.236173 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dc798bd8-e763-4908-9db8-0b36526558b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:32.243867 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-dc798bd8-e763-4908-9db8-0b36526558b5 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1672 microversion: 2.1 time: 0.311113 Jun 22 18:48:32.244417 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 561/1074] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:31 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1672 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:33.109502 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-b86ffe2e-766a-40da-a845-e40dac785ae5 req-71e4826f-e70e-44a4-9c09-1bdcc0939b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bafe5e2-07f8-48e3-b700-aad1a45c4bfc", "name": "network-vif-deleted", "tag": "07fd9689-cb5a-4787-85ff-a11df5f3901c"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:48:33.119048 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-b86ffe2e-766a-40da-a845-e40dac785ae5 req-71e4826f-e70e-44a4-9c09-1bdcc0939b20 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:33.119751 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-b86ffe2e-766a-40da-a845-e40dac785ae5 req-71e4826f-e70e-44a4-9c09-1bdcc0939b20 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:33.132694 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-b86ffe2e-766a-40da-a845-e40dac785ae5 req-71e4826f-e70e-44a4-9c09-1bdcc0939b20 service nova] Creating event network-vif-deleted:07fd9689-cb5a-4787-85ff-a11df5f3901c for instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc on hv-cinder-81268 Jun 22 18:48:33.137478 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-b86ffe2e-766a-40da-a845-e40dac785ae5 req-71e4826f-e70e-44a4-9c09-1bdcc0939b20 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033612 Jun 22 18:48:33.138072 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 514/1075] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:33.260862 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9497ca81-9681-485b-b66f-e39a09c5d8c6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:33.262015 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9497ca81-9681-485b-b66f-e39a09c5d8c6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:33.269471 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9497ca81-9681-485b-b66f-e39a09c5d8c6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:33.270708 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9497ca81-9681-485b-b66f-e39a09c5d8c6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:33.271699 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9497ca81-9681-485b-b66f-e39a09c5d8c6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:33.272333 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9497ca81-9681-485b-b66f-e39a09c5d8c6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:33.315945 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9497ca81-9681-485b-b66f-e39a09c5d8c6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:33.315945 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9497ca81-9681-485b-b66f-e39a09c5d8c6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:33.315945 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-9497ca81-9681-485b-b66f-e39a09c5d8c6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lazy-loading 'fault' on Instance uuid 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:48:33.356195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9497ca81-9681-485b-b66f-e39a09c5d8c6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32582f1a1994e3b9c05f56185d0079d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91b10b850024bae8e0d76aa9628224d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:33.364774 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9497ca81-9681-485b-b66f-e39a09c5d8c6 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 200 len: 1326 microversion: 2.1 time: 0.107734 Jun 22 18:48:33.365347 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 562/1076] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:33 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 1326 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:34.383472 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3e6d05eb-f9d8-4352-9318-d402a7d752b3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:34.384295 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3e6d05eb-f9d8-4352-9318-d402a7d752b3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:34.391222 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3e6d05eb-f9d8-4352-9318-d402a7d752b3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:34.391668 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3e6d05eb-f9d8-4352-9318-d402a7d752b3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:34.392464 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3e6d05eb-f9d8-4352-9318-d402a7d752b3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:34.392904 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3e6d05eb-f9d8-4352-9318-d402a7d752b3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:34.407986 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-3e6d05eb-f9d8-4352-9318-d402a7d752b3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] HTTP exception thrown: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3e6d05eb-f9d8-4352-9318-d402a7d752b3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Request method failure captured: Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc HTTP/1.1 Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GMT04a9HhiLbZ6CXtENETzHuBCWqYHm_PV01cxItErRqYF8vGOHB5yij8nrcjja8JbYnm97hnEwO-hp8XT_WEZUO7L0agarh-ZJASLsNdnMc9OQNK2jVrm4G8zrtQJT5GOcuHDs7f7oL_abRoO5IY9-sxUnFUme4q1kwnC-oyXxdc Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: b91b10b850024bae8e0d76aa9628224d Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:48:34.409615 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:48:34.411300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b91b10b850024bae8e0d76aa9628224d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:48:34.411300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:34.411300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: b91b10b850024bae8e0d76aa9628224d Jun 22 18:48:34.411300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:34.411300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeTestJSON-142553001-project Jun 22 18:48:34.411300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:48:34.411300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:48:34.411300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: d32582f1a1994e3b9c05f56185d0079d Jun 22 18:48:34.411300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeTestJSON-142553001-project Jun 22 18:48:34.411300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:48:34.411300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:34.411300 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '4bafe5e2-07f8-48e3-b700-aad1a45c4bfc'} Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:48:34.412345 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:34.413887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:34.415629 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3e6d05eb-f9d8-4352-9318-d402a7d752b3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Returning 404 to user: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:48:34.415629 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3e6d05eb-f9d8-4352-9318-d402a7d752b3 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 404 len: 111 microversion: 2.1 time: 0.032251 Jun 22 18:48:34.415629 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 515/1077] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:34 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:48:34.420185 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-65474cdc-d731-4bc9-9cdb-c9e5aa5b982f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '.version_select at 0x7fd755476700>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:34.423560 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR oslo.messaging._drivers.impl_rabbit [None req-65474cdc-d731-4bc9-9cdb-c9e5aa5b982f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [643aa847-dc08-431d-8b71-b1ed14d5449c] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 18:48:35.431084 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO oslo.messaging._drivers.impl_rabbit [None req-65474cdc-d731-4bc9-9cdb-c9e5aa5b982f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [643aa847-dc08-431d-8b71-b1ed14d5449c] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52528. Jun 22 18:48:35.449807 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-65474cdc-d731-4bc9-9cdb-c9e5aa5b982f tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-786220574" status: 202 len: 0 microversion: 2.1 time: 1.033569 Jun 22 18:48:35.450374 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 563/1078] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jun 22 18:48:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-786220574 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:48:39.443154 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-144603457", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "networks": [{"uuid": "cfd8a78e-1ba4-49d7-8b2c-aca1dbfae09f"}]}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:48:39.497538 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.network.neutron [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] validate_networks() for [('cfd8a78e-1ba4-49d7-8b2c-aca1dbfae09f', None, None, None, None, None)] {{(pid=129743) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:48:39.906939 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Flavor limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:48:39.907580 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Image limits 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:48:39.908134 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Flavor pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:48:39.908538 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Image pref 0:0:0 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:48:39.908940 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.virt.hardware [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:48:39.918820 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:39.919308 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:39.920902 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:39.921412 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:39.939047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Getting quotas for project 500e8157246e450ea87f751218856c7a. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:48:39.942955 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Getting quotas for user 5b995c6bf02b4e50aa836324c6f3414e and project 500e8157246e450ea87f751218856c7a. Resources: {'cores', 'instances', 'ram'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:48:39.954836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Going to run 1 instances... {{(pid=129743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:48:39.957768 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:48:40.009517 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b57c7179-06f3-4573-8c76-050a419402e0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570344 Jun 22 18:48:40.010153 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 516/1079] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:48:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:48:40.021232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4e2a952b-7373-4092-83de-391ffd65dc8d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:40.021870 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4e2a952b-7373-4092-83de-391ffd65dc8d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:40.075806 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4e2a952b-7373-4092-83de-391ffd65dc8d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:40.083329 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4e2a952b-7373-4092-83de-391ffd65dc8d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1218 microversion: 2.1 time: 0.066409 Jun 22 18:48:40.084192 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 564/1080] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:40 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:40.748995 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5bbf20c8-ffc4-4d9a-9457-566cbb41eb02 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6354e859-49d1-4eee-a6d0-600ff5874a72"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:48:40.750268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5bbf20c8-ffc4-4d9a-9457-566cbb41eb02 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:40.761417 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5bbf20c8-ffc4-4d9a-9457-566cbb41eb02 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:40.761867 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5bbf20c8-ffc4-4d9a-9457-566cbb41eb02 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:40.762646 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5bbf20c8-ffc4-4d9a-9457-566cbb41eb02 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:40.763234 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5bbf20c8-ffc4-4d9a-9457-566cbb41eb02 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:40.845028 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-5bbf20c8-ffc4-4d9a-9457-566cbb41eb02 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Invalid volume: volume 6354e859-49d1-4eee-a6d0-600ff5874a72 is already attached to instances: e9b8c26d-8d82-435d-b4c7-98f8ced7d279 Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5bbf20c8-ffc4-4d9a-9457-566cbb41eb02 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: POST /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-volume_attachments HTTP/1.1 Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 74 Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:48:40.846630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:48:40.848177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:48:40.848177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:48:40.848177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:48:40.848177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:48:40.848177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:48:40.848177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:48:40.848177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:48:40.848177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:48:40.848177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:48:40.848177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Jun 22 18:48:40.848177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {"volumeAttachment": {"volumeId": "6354e859-49d1-4eee-a6d0-600ff5874a72"}} Jun 22 18:48:40.848177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Invalid volume: volume 6354e859-49d1-4eee-a6d0-600ff5874a72 is already attached to instances: e9b8c26d-8d82-435d-b4c7-98f8ced7d279 Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'server_id': 'e9b8c26d-8d82-435d-b4c7-98f8ced7d279', 'body': {'volumeAttachment': {'volumeId': '6354e859-49d1-4eee-a6d0-600ff5874a72'}}} Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6354e859-49d1-4eee-a6d0-600ff5874a72 is already attached to instances: e9b8c26d-8d82-435d-b4c7-98f8ced7d279 Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:40.849061 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6354e859-49d1-4eee-a6d0-600ff5874a72 is already attached to instances: e9b8c26d-8d82-435d-b4c7-98f8ced7d279 Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:40.850268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:40.851468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:40.851468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:48:40.851468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:48:40.851468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6354e859-49d1-4eee-a6d0-600ff5874a72 is already attached to instances: e9b8c26d-8d82-435d-b4c7-98f8ced7d279 Jun 22 18:48:40.851468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:40.851468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5bbf20c8-ffc4-4d9a-9457-566cbb41eb02 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 400 to user: Invalid volume: volume 6354e859-49d1-4eee-a6d0-600ff5874a72 is already attached to instances: e9b8c26d-8d82-435d-b4c7-98f8ced7d279 {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:48:40.851468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5bbf20c8-ffc4-4d9a-9457-566cbb41eb02 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "POST /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103379 Jun 22 18:48:40.851468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 517/1081] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:48:40 2022] POST /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 18:48:40.912468 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-34a5360b-6ebd-432d-9049-685d0b4e4c44 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:40.912972 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-34a5360b-6ebd-432d-9049-685d0b4e4c44 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:40.919634 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-34a5360b-6ebd-432d-9049-685d0b4e4c44 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:40.920712 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-34a5360b-6ebd-432d-9049-685d0b4e4c44 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:40.921500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-34a5360b-6ebd-432d-9049-685d0b4e4c44 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:40.921939 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-34a5360b-6ebd-432d-9049-685d0b4e4c44 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:41.003851 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-34a5360b-6ebd-432d-9049-685d0b4e4c44 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lazy-loading 'services' on Instance uuid e9b8c26d-8d82-435d-b4c7-98f8ced7d279 {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:48:41.084099 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-34a5360b-6ebd-432d-9049-685d0b4e4c44 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-volume_attachments/6354e859-49d1-4eee-a6d0-600ff5874a72" status: 202 len: 0 microversion: 2.1 time: 0.175213 Jun 22 18:48:41.085827 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 565/1082] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 18:48:40 2022] DELETE /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-volume_attachments/6354e859-49d1-4eee-a6d0-600ff5874a72 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:48:41.101635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-18b8f194-f6c8-4dfa-9b1f-ced61545a013 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:41.102477 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-33b9952e-83ea-4420-9ba6-73bb4259450d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:41.103409 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-33b9952e-83ea-4420-9ba6-73bb4259450d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:41.107056 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-18b8f194-f6c8-4dfa-9b1f-ced61545a013 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:41.114579 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-33b9952e-83ea-4420-9ba6-73bb4259450d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:41.116745 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-18b8f194-f6c8-4dfa-9b1f-ced61545a013 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:41.117125 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-33b9952e-83ea-4420-9ba6-73bb4259450d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:41.117536 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-18b8f194-f6c8-4dfa-9b1f-ced61545a013 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:41.118388 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-18b8f194-f6c8-4dfa-9b1f-ced61545a013 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:41.118586 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-33b9952e-83ea-4420-9ba6-73bb4259450d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:41.119074 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-18b8f194-f6c8-4dfa-9b1f-ced61545a013 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:41.119238 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-33b9952e-83ea-4420-9ba6-73bb4259450d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:41.159141 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-18b8f194-f6c8-4dfa-9b1f-ced61545a013 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068962 Jun 22 18:48:41.163222 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 518/1083] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:48:41 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:48:41.209005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-33b9952e-83ea-4420-9ba6-73bb4259450d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:41.218017 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-33b9952e-83ea-4420-9ba6-73bb4259450d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1288 microversion: 2.1 time: 0.119837 Jun 22 18:48:41.218587 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 566/1084] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:41 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1288 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:48:41.605583 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-13bd15da-857d-40ff-96aa-1975cbbad718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:41.606198 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-13bd15da-857d-40ff-96aa-1975cbbad718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:41.613451 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-13bd15da-857d-40ff-96aa-1975cbbad718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:41.613905 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-13bd15da-857d-40ff-96aa-1975cbbad718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:41.614688 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-13bd15da-857d-40ff-96aa-1975cbbad718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:41.615127 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-13bd15da-857d-40ff-96aa-1975cbbad718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:41.619654 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:41.631150 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-13bd15da-857d-40ff-96aa-1975cbbad718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] HTTP exception thrown: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-13bd15da-857d-40ff-96aa-1975cbbad718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Request method failure captured: Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: DELETE /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc HTTP/1.1 Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GMT04a9HhiLbZ6CXtENETzHuBCWqYHm_PV01cxItErRqYF8vGOHB5yij8nrcjja8JbYnm97hnEwO-hp8XT_WEZUO7L0agarh-ZJASLsNdnMc9OQNK2jVrm4G8zrtQJT5GOcuHDs7f7oL_abRoO5IY9-sxUnFUme4q1kwnC-oyXxdc Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: b91b10b850024bae8e0d76aa9628224d Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:48:41.632919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:48:41.634514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b91b10b850024bae8e0d76aa9628224d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:48:41.634514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:41.634514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: b91b10b850024bae8e0d76aa9628224d Jun 22 18:48:41.634514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:41.634514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeTestJSON-142553001-project Jun 22 18:48:41.634514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:48:41.634514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:48:41.634514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: d32582f1a1994e3b9c05f56185d0079d Jun 22 18:48:41.634514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeTestJSON-142553001-project Jun 22 18:48:41.634514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:48:41.634514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:41.634514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '4bafe5e2-07f8-48e3-b700-aad1a45c4bfc'} Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:48:41.635375 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:41.636714 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:41.638199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-13bd15da-857d-40ff-96aa-1975cbbad718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Returning 404 to user: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:48:41.638199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-13bd15da-857d-40ff-96aa-1975cbbad718 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 404 len: 111 microversion: 2.1 time: 0.032722 Jun 22 18:48:41.638199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 519/1085] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:48:41 2022] DELETE /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:48:41.644122 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-27509091-b31d-4aa4-980d-175bf318243c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:41.644978 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-27509091-b31d-4aa4-980d-175bf318243c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:41.652552 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-27509091-b31d-4aa4-980d-175bf318243c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:41.652997 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-27509091-b31d-4aa4-980d-175bf318243c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:41.653764 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-27509091-b31d-4aa4-980d-175bf318243c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:41.654205 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-27509091-b31d-4aa4-980d-175bf318243c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:41.668285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-27509091-b31d-4aa4-980d-175bf318243c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] HTTP exception thrown: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-27509091-b31d-4aa4-980d-175bf318243c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Request method failure captured: Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc HTTP/1.1 Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2GMT04a9HhiLbZ6CXtENETzHuBCWqYHm_PV01cxItErRqYF8vGOHB5yij8nrcjja8JbYnm97hnEwO-hp8XT_WEZUO7L0agarh-ZJASLsNdnMc9OQNK2jVrm4G8zrtQJT5GOcuHDs7f7oL_abRoO5IY9-sxUnFUme4q1kwnC-oyXxdc Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: b91b10b850024bae8e0d76aa9628224d Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:48:41.670053 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:48:41.672893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b91b10b850024bae8e0d76aa9628224d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:48:41.672893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:41.672893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: b91b10b850024bae8e0d76aa9628224d Jun 22 18:48:41.672893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:41.672893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-AttachVolumeTestJSON-142553001-project Jun 22 18:48:41.672893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:48:41.672893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:48:41.672893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: d32582f1a1994e3b9c05f56185d0079d Jun 22 18:48:41.672893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-AttachVolumeTestJSON-142553001-project Jun 22 18:48:41.672893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:48:41.672893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:41.672893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '4bafe5e2-07f8-48e3-b700-aad1a45c4bfc'} Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:48:41.673921 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. Jun 22 18:48:41.675428 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:41.676826 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-27509091-b31d-4aa4-980d-175bf318243c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Returning 404 to user: Instance 4bafe5e2-07f8-48e3-b700-aad1a45c4bfc could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:48:41.676826 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-27509091-b31d-4aa4-980d-175bf318243c tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc" status: 404 len: 111 microversion: 2.1 time: 0.032298 Jun 22 18:48:41.676826 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 567/1086] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:41 2022] GET /compute/v2.1/servers/4bafe5e2-07f8-48e3-b700-aad1a45c4bfc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:48:42.178524 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d8c6720b-6004-461e-9a02-6bff85a6200c tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:42.180737 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d8c6720b-6004-461e-9a02-6bff85a6200c tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:42.190213 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d8c6720b-6004-461e-9a02-6bff85a6200c tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:42.190509 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d8c6720b-6004-461e-9a02-6bff85a6200c tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:42.191596 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d8c6720b-6004-461e-9a02-6bff85a6200c tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:42.192286 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d8c6720b-6004-461e-9a02-6bff85a6200c tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:42.226443 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d8c6720b-6004-461e-9a02-6bff85a6200c tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059508 Jun 22 18:48:42.231553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 520/1087] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:48:42 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:42.237415 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-57f44a51-7e62-4564-a572-a1b9ebd99b4b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:42.238023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-57f44a51-7e62-4564-a572-a1b9ebd99b4b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:42.244616 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-57f44a51-7e62-4564-a572-a1b9ebd99b4b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:42.245075 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-57f44a51-7e62-4564-a572-a1b9ebd99b4b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:42.245843 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-57f44a51-7e62-4564-a572-a1b9ebd99b4b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:42.246463 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-57f44a51-7e62-4564-a572-a1b9ebd99b4b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:42.398770 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-57f44a51-7e62-4564-a572-a1b9ebd99b4b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:42.407127 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-57f44a51-7e62-4564-a572-a1b9ebd99b4b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1318 microversion: 2.1 time: 0.174269 Jun 22 18:48:42.407784 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 568/1088] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:42 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:42.478721 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-119b682e-6e24-4ac4-b7ef-5f8f0fdb3af6 req-2c4aa909-d79a-44c1-b9b3-e6e4138347b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb3b050-8559-4934-8357-efabd72c4c10", "tag": "2d5ddc2a-3a47-4887-ab1f-85e3ebf528d6"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:48:42.486986 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-119b682e-6e24-4ac4-b7ef-5f8f0fdb3af6 req-2c4aa909-d79a-44c1-b9b3-e6e4138347b5 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:42.487700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-119b682e-6e24-4ac4-b7ef-5f8f0fdb3af6 req-2c4aa909-d79a-44c1-b9b3-e6e4138347b5 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:42.499637 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-119b682e-6e24-4ac4-b7ef-5f8f0fdb3af6 req-2c4aa909-d79a-44c1-b9b3-e6e4138347b5 service nova] Creating event network-changed:2d5ddc2a-3a47-4887-ab1f-85e3ebf528d6 for instance 4fb3b050-8559-4934-8357-efabd72c4c10 on hv-cinder-81268 Jun 22 18:48:42.505018 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-119b682e-6e24-4ac4-b7ef-5f8f0fdb3af6 req-2c4aa909-d79a-44c1-b9b3-e6e4138347b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029889 Jun 22 18:48:42.505611 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 521/1089] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:42.825129 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-14e55682-3456-4cdb-9a9d-43491df42e60 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:42.825633 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-14e55682-3456-4cdb-9a9d-43491df42e60 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:42.832183 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-14e55682-3456-4cdb-9a9d-43491df42e60 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:42.832672 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-14e55682-3456-4cdb-9a9d-43491df42e60 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:42.833444 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-14e55682-3456-4cdb-9a9d-43491df42e60 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:42.833883 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-14e55682-3456-4cdb-9a9d-43491df42e60 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:42.848399 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-14e55682-3456-4cdb-9a9d-43491df42e60 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] HTTP exception thrown: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-14e55682-3456-4cdb-9a9d-43491df42e60 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Request method failure captured: Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: DELETE /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc HTTP/1.1 Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2GMT04a9HhiLbZ6CXtENETzHuBCWqYHm_PV01cxItErRqYF8vGOHB5yij8nrcjja8JbYnm97hnEwO-hp8XT_WEZUO7L0agarh-ZJASLsNdnMc9OQNK2jVrm4G8zrtQJT5GOcuHDs7f7oL_abRoO5IY9-sxUnFUme4q1kwnC-oyXxdc Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: b91b10b850024bae8e0d76aa9628224d Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:48:42.849984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:48:42.851565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b91b10b850024bae8e0d76aa9628224d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:48:42.851565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:42.851565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: b91b10b850024bae8e0d76aa9628224d Jun 22 18:48:42.851565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:42.851565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-AttachVolumeTestJSON-142553001-project Jun 22 18:48:42.851565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:48:42.851565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:48:42.851565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: d32582f1a1994e3b9c05f56185d0079d Jun 22 18:48:42.851565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-AttachVolumeTestJSON-142553001-project Jun 22 18:48:42.851565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:48:42.851565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:48:42.851565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '2a9799ba-7e8d-4145-b942-752d45813cfc'} Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:48:42.852492 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:48:42.853942 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:42.855504 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-14e55682-3456-4cdb-9a9d-43491df42e60 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Returning 404 to user: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:48:42.855504 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-14e55682-3456-4cdb-9a9d-43491df42e60 tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 404 len: 111 microversion: 2.1 time: 0.030119 Jun 22 18:48:42.855504 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 569/1090] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:48:42 2022] DELETE /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:48:42.861074 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-91856e81-071c-4c4a-91b9-507b376bba6a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:42.861856 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-91856e81-071c-4c4a-91b9-507b376bba6a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] [instance: 2a9799ba-7e8d-4145-b942-752d45813cfc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:42.868452 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91856e81-071c-4c4a-91b9-507b376bba6a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:42.868988 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91856e81-071c-4c4a-91b9-507b376bba6a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:42.869834 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91856e81-071c-4c4a-91b9-507b376bba6a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:42.870331 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-91856e81-071c-4c4a-91b9-507b376bba6a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:42.885351 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-91856e81-071c-4c4a-91b9-507b376bba6a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] HTTP exception thrown: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-91856e81-071c-4c4a-91b9-507b376bba6a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Request method failure captured: Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc HTTP/1.1 Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GMT04a9HhiLbZ6CXtENETzHuBCWqYHm_PV01cxItErRqYF8vGOHB5yij8nrcjja8JbYnm97hnEwO-hp8XT_WEZUO7L0agarh-ZJASLsNdnMc9OQNK2jVrm4G8zrtQJT5GOcuHDs7f7oL_abRoO5IY9-sxUnFUme4q1kwnC-oyXxdc Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: b91b10b850024bae8e0d76aa9628224d Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:48:42.887117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:48:42.888710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b91b10b850024bae8e0d76aa9628224d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b91b10b850024bae8e0d76aa9628224d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:48:42.888710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:42.888710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: b91b10b850024bae8e0d76aa9628224d Jun 22 18:48:42.888710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-142553001 Jun 22 18:48:42.888710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeTestJSON-142553001-project Jun 22 18:48:42.888710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:48:42.888710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:48:42.888710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: d32582f1a1994e3b9c05f56185d0079d Jun 22 18:48:42.888710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeTestJSON-142553001-project Jun 22 18:48:42.888710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:48:42.888710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:48:42.888710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '2a9799ba-7e8d-4145-b942-752d45813cfc'} Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:48:42.890280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. Jun 22 18:48:42.891805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:48:42.893117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-91856e81-071c-4c4a-91b9-507b376bba6a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] Returning 404 to user: Instance 2a9799ba-7e8d-4145-b942-752d45813cfc could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:48:42.893117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-91856e81-071c-4c4a-91b9-507b376bba6a tempest-AttachVolumeTestJSON-142553001 tempest-AttachVolumeTestJSON-142553001-project] 10.222.0.18 "GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc" status: 404 len: 111 microversion: 2.1 time: 0.032138 Jun 22 18:48:42.895922 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 522/1091] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:42 2022] GET /compute/v2.1/servers/2a9799ba-7e8d-4145-b942-752d45813cfc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:48:43.238215 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2ee279cc-3526-4d92-ac0c-e628023768f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:43.239123 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2ee279cc-3526-4d92-ac0c-e628023768f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:43.245632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2ee279cc-3526-4d92-ac0c-e628023768f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:43.246117 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2ee279cc-3526-4d92-ac0c-e628023768f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:43.246888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2ee279cc-3526-4d92-ac0c-e628023768f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:43.247325 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2ee279cc-3526-4d92-ac0c-e628023768f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:43.277841 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2ee279cc-3526-4d92-ac0c-e628023768f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043672 Jun 22 18:48:43.278394 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 570/1092] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:48:43 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 18:48:43.336682 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2377ea4e-aa9b-4eab-963e-c5515e2d58d1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:43.337251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2377ea4e-aa9b-4eab-963e-c5515e2d58d1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:43.344857 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2377ea4e-aa9b-4eab-963e-c5515e2d58d1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:43.345382 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2377ea4e-aa9b-4eab-963e-c5515e2d58d1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:43.346161 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2377ea4e-aa9b-4eab-963e-c5515e2d58d1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:43.346596 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2377ea4e-aa9b-4eab-963e-c5515e2d58d1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:43.372247 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2377ea4e-aa9b-4eab-963e-c5515e2d58d1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Going to try to terminate instance {{(pid=129743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:48:43.424574 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6e7d762d-4271-4738-a558-5480934ffbe4 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:43.425695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6e7d762d-4271-4738-a558-5480934ffbe4 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:43.432627 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6e7d762d-4271-4738-a558-5480934ffbe4 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:43.433304 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6e7d762d-4271-4738-a558-5480934ffbe4 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:43.434433 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6e7d762d-4271-4738-a558-5480934ffbe4 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:43.435033 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6e7d762d-4271-4738-a558-5480934ffbe4 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:43.456951 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2377ea4e-aa9b-4eab-963e-c5515e2d58d1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 204 len: 0 microversion: 2.1 time: 0.124014 Jun 22 18:48:43.457515 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 523/1093] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:48:43 2022] DELETE /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:48:43.465993 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-024d01e5-e790-465c-8036-c4b224e4bd3d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:43.466687 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-024d01e5-e790-465c-8036-c4b224e4bd3d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:43.476135 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-024d01e5-e790-465c-8036-c4b224e4bd3d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:43.476326 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-024d01e5-e790-465c-8036-c4b224e4bd3d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:43.477602 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-024d01e5-e790-465c-8036-c4b224e4bd3d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:43.478114 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-024d01e5-e790-465c-8036-c4b224e4bd3d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:43.612015 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-024d01e5-e790-465c-8036-c4b224e4bd3d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:43.620152 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-024d01e5-e790-465c-8036-c4b224e4bd3d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1679 microversion: 2.1 time: 0.158055 Jun 22 18:48:43.620800 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 524/1094] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:43 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:48:43.884627 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6e7d762d-4271-4738-a558-5480934ffbe4 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:43.894546 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6e7d762d-4271-4738-a558-5480934ffbe4 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1318 microversion: 2.1 time: 0.474197 Jun 22 18:48:43.895538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 571/1095] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:43 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:48:44.638897 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6b01fc2c-0aca-494a-9488-5a50c9b7de43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:44.640063 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6b01fc2c-0aca-494a-9488-5a50c9b7de43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:44.646600 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6b01fc2c-0aca-494a-9488-5a50c9b7de43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:44.647044 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6b01fc2c-0aca-494a-9488-5a50c9b7de43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:44.648119 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6b01fc2c-0aca-494a-9488-5a50c9b7de43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:44.648546 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6b01fc2c-0aca-494a-9488-5a50c9b7de43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:44.797839 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6b01fc2c-0aca-494a-9488-5a50c9b7de43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:44.806602 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6b01fc2c-0aca-494a-9488-5a50c9b7de43 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1679 microversion: 2.1 time: 0.171441 Jun 22 18:48:44.807544 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 525/1096] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:44 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:44.912148 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a58fae2f-e3dd-4426-ae69-3d6be6e99908 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:44.912873 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a58fae2f-e3dd-4426-ae69-3d6be6e99908 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:44.919675 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a58fae2f-e3dd-4426-ae69-3d6be6e99908 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:44.920397 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a58fae2f-e3dd-4426-ae69-3d6be6e99908 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:44.921607 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a58fae2f-e3dd-4426-ae69-3d6be6e99908 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:44.922130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a58fae2f-e3dd-4426-ae69-3d6be6e99908 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:45.122303 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a58fae2f-e3dd-4426-ae69-3d6be6e99908 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:45.130845 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a58fae2f-e3dd-4426-ae69-3d6be6e99908 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1318 microversion: 2.1 time: 0.223018 Jun 22 18:48:45.131522 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 572/1097] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:44 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:45.825879 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-cf411c29-a3b8-4cf5-a8e7-0b1919625218 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:45.827138 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-cf411c29-a3b8-4cf5-a8e7-0b1919625218 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:45.834234 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cf411c29-a3b8-4cf5-a8e7-0b1919625218 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:45.834915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cf411c29-a3b8-4cf5-a8e7-0b1919625218 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:45.835865 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cf411c29-a3b8-4cf5-a8e7-0b1919625218 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:45.836816 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cf411c29-a3b8-4cf5-a8e7-0b1919625218 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:46.004470 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cf411c29-a3b8-4cf5-a8e7-0b1919625218 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:46.016120 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-cf411c29-a3b8-4cf5-a8e7-0b1919625218 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1679 microversion: 2.1 time: 0.195413 Jun 22 18:48:46.017440 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 526/1098] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:45 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1679 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:46.153111 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e106dd22-3670-4c61-b94b-c344fb60071a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:46.153877 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e106dd22-3670-4c61-b94b-c344fb60071a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:46.160963 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e106dd22-3670-4c61-b94b-c344fb60071a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:46.161409 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e106dd22-3670-4c61-b94b-c344fb60071a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:46.162180 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e106dd22-3670-4c61-b94b-c344fb60071a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:46.162903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e106dd22-3670-4c61-b94b-c344fb60071a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:46.369106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e106dd22-3670-4c61-b94b-c344fb60071a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:46.378058 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e106dd22-3670-4c61-b94b-c344fb60071a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1318 microversion: 2.1 time: 0.232870 Jun 22 18:48:46.378632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 573/1099] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:46 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:47.034175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-244bde13-e1ed-4f62-a97b-38b30afe1ff0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:47.034910 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-244bde13-e1ed-4f62-a97b-38b30afe1ff0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:47.041267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-244bde13-e1ed-4f62-a97b-38b30afe1ff0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:47.041721 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-244bde13-e1ed-4f62-a97b-38b30afe1ff0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:47.042487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-244bde13-e1ed-4f62-a97b-38b30afe1ff0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:47.042920 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-244bde13-e1ed-4f62-a97b-38b30afe1ff0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:47.175909 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-244bde13-e1ed-4f62-a97b-38b30afe1ff0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:47.183527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-244bde13-e1ed-4f62-a97b-38b30afe1ff0 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1679 microversion: 2.1 time: 0.153769 Jun 22 18:48:47.184114 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 527/1100] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:47 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:47.395255 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-28fa34b8-e89a-4ae4-9ebb-2c09e0db6194 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:47.395888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-28fa34b8-e89a-4ae4-9ebb-2c09e0db6194 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:47.402353 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-28fa34b8-e89a-4ae4-9ebb-2c09e0db6194 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:47.403042 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-28fa34b8-e89a-4ae4-9ebb-2c09e0db6194 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:47.403822 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-28fa34b8-e89a-4ae4-9ebb-2c09e0db6194 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:47.404283 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-28fa34b8-e89a-4ae4-9ebb-2c09e0db6194 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:47.551985 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-28fa34b8-e89a-4ae4-9ebb-2c09e0db6194 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:47.560333 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-28fa34b8-e89a-4ae4-9ebb-2c09e0db6194 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1318 microversion: 2.1 time: 0.168851 Jun 22 18:48:47.560945 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 574/1101] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:47 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:48.200957 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-baef9c09-9265-4502-a124-233b89015396 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:48.202101 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-baef9c09-9265-4502-a124-233b89015396 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:48.208045 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:48.209765 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-baef9c09-9265-4502-a124-233b89015396 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:48.210420 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-baef9c09-9265-4502-a124-233b89015396 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:48.211343 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-baef9c09-9265-4502-a124-233b89015396 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:48.211958 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-baef9c09-9265-4502-a124-233b89015396 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:48.474081 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-baef9c09-9265-4502-a124-233b89015396 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:48.484402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-baef9c09-9265-4502-a124-233b89015396 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1679 microversion: 2.1 time: 0.286964 Jun 22 18:48:48.500465 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 528/1102] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:48 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1679 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:48.578337 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a7fcf06c-0262-44c1-a220-35a24d93f489 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:48.579552 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a7fcf06c-0262-44c1-a220-35a24d93f489 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:48.587099 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a7fcf06c-0262-44c1-a220-35a24d93f489 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:48.588025 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a7fcf06c-0262-44c1-a220-35a24d93f489 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:48.589256 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a7fcf06c-0262-44c1-a220-35a24d93f489 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:48.589936 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a7fcf06c-0262-44c1-a220-35a24d93f489 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:48.802657 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a7fcf06c-0262-44c1-a220-35a24d93f489 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:48.811365 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a7fcf06c-0262-44c1-a220-35a24d93f489 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1318 microversion: 2.1 time: 0.237401 Jun 22 18:48:48.812324 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 575/1103] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:48 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:48.977912 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-d9d8ee5c-72c6-4c9e-8a09-37dd54aca1b3 req-6442d6ea-d5ef-4a90-a6d9-e61dca5e8f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b8c26d-8d82-435d-b4c7-98f8ced7d279", "name": "network-vif-deleted", "tag": "186f392c-4dc9-4a86-99dd-a4ad5e725602"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:48:48.987644 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-d9d8ee5c-72c6-4c9e-8a09-37dd54aca1b3 req-6442d6ea-d5ef-4a90-a6d9-e61dca5e8f96 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:48.988275 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-d9d8ee5c-72c6-4c9e-8a09-37dd54aca1b3 req-6442d6ea-d5ef-4a90-a6d9-e61dca5e8f96 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:49.000512 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-d9d8ee5c-72c6-4c9e-8a09-37dd54aca1b3 req-6442d6ea-d5ef-4a90-a6d9-e61dca5e8f96 service nova] Creating event network-vif-deleted:186f392c-4dc9-4a86-99dd-a4ad5e725602 for instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 on hv-cinder-81268 Jun 22 18:48:49.006209 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-d9d8ee5c-72c6-4c9e-8a09-37dd54aca1b3 req-6442d6ea-d5ef-4a90-a6d9-e61dca5e8f96 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032006 Jun 22 18:48:49.006913 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 529/1104] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:49.503941 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1bfe3c12-bb26-4f1d-9a3b-1b41ca9359bf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:49.504825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-1bfe3c12-bb26-4f1d-9a3b-1b41ca9359bf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:49.511656 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1bfe3c12-bb26-4f1d-9a3b-1b41ca9359bf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:49.512146 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1bfe3c12-bb26-4f1d-9a3b-1b41ca9359bf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:49.513325 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1bfe3c12-bb26-4f1d-9a3b-1b41ca9359bf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:49.513875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1bfe3c12-bb26-4f1d-9a3b-1b41ca9359bf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:49.581251 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1bfe3c12-bb26-4f1d-9a3b-1b41ca9359bf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:49.581918 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1bfe3c12-bb26-4f1d-9a3b-1b41ca9359bf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:49.582155 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-1bfe3c12-bb26-4f1d-9a3b-1b41ca9359bf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lazy-loading 'fault' on Instance uuid e9b8c26d-8d82-435d-b4c7-98f8ced7d279 {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:48:49.642839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-1bfe3c12-bb26-4f1d-9a3b-1b41ca9359bf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:49.652192 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-1bfe3c12-bb26-4f1d-9a3b-1b41ca9359bf tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 200 len: 1329 microversion: 2.1 time: 0.154460 Jun 22 18:48:49.665512 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 576/1105] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:49 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 1329 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:48:49.831184 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ffd4b0d0-db3f-4fa0-8c37-f793c988c265 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:49.831999 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ffd4b0d0-db3f-4fa0-8c37-f793c988c265 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:49.843574 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ffd4b0d0-db3f-4fa0-8c37-f793c988c265 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:49.844694 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ffd4b0d0-db3f-4fa0-8c37-f793c988c265 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:49.845649 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ffd4b0d0-db3f-4fa0-8c37-f793c988c265 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:49.846283 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ffd4b0d0-db3f-4fa0-8c37-f793c988c265 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:49.923017 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-8226a2fc-9e6e-441b-a2bc-4edbb197b9c1 req-bd85e39c-28a8-446b-b89f-31b1e5ce39c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb3b050-8559-4934-8357-efabd72c4c10", "name": "network-vif-plugged", "status": "completed", "tag": "2d5ddc2a-3a47-4887-ab1f-85e3ebf528d6"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:48:49.929625 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:49.942550 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-8226a2fc-9e6e-441b-a2bc-4edbb197b9c1 req-bd85e39c-28a8-446b-b89f-31b1e5ce39c6 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:49.943099 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-8226a2fc-9e6e-441b-a2bc-4edbb197b9c1 req-bd85e39c-28a8-446b-b89f-31b1e5ce39c6 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:49.950004 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=6 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:49.969436 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-8226a2fc-9e6e-441b-a2bc-4edbb197b9c1 req-bd85e39c-28a8-446b-b89f-31b1e5ce39c6 service nova] Creating event network-vif-plugged:2d5ddc2a-3a47-4887-ab1f-85e3ebf528d6 for instance 4fb3b050-8559-4934-8357-efabd72c4c10 on hv-cinder-81268 Jun 22 18:48:49.985380 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-8226a2fc-9e6e-441b-a2bc-4edbb197b9c1 req-bd85e39c-28a8-446b-b89f-31b1e5ce39c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068125 Jun 22 18:48:49.986287 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 577/1106] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:50.057159 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ffd4b0d0-db3f-4fa0-8c37-f793c988c265 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:50.066599 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ffd4b0d0-db3f-4fa0-8c37-f793c988c265 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1318 microversion: 2.1 time: 0.240482 Jun 22 18:48:50.067171 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 530/1107] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:49 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:50.670106 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:50.675805 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1a667343-fece-418b-a1fc-88a905010ca5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:50.676529 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-1a667343-fece-418b-a1fc-88a905010ca5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:50.683219 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1a667343-fece-418b-a1fc-88a905010ca5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:50.683673 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1a667343-fece-418b-a1fc-88a905010ca5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:50.684469 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1a667343-fece-418b-a1fc-88a905010ca5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:50.684907 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1a667343-fece-418b-a1fc-88a905010ca5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:50.702838 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-1a667343-fece-418b-a1fc-88a905010ca5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1a667343-fece-418b-a1fc-88a905010ca5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 HTTP/1.1 Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:48:50.704537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:48:50.706160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:48:50.706160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:48:50.706160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:48:50.706160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:48:50.706160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:48:50.706160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:48:50.706160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:48:50.706160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:48:50.706160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:48:50.706160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:48:50.706160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:48:50.706160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': 'e9b8c26d-8d82-435d-b4c7-98f8ced7d279'} Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:48:50.707072 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:48:50.708569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:48:50.709825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1a667343-fece-418b-a1fc-88a905010ca5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 404 to user: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:48:50.709825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-1a667343-fece-418b-a1fc-88a905010ca5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 404 len: 111 microversion: 2.1 time: 0.037028 Jun 22 18:48:50.710019 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 578/1108] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:50 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:48:50.714638 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1f858e63-37ec-4c39-9d0b-96c2ebead161 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '.version_select at 0x7fd755686670>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:50.734637 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1f858e63-37ec-4c39-9d0b-96c2ebead161 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-708331976" status: 202 len: 0 microversion: 2.1 time: 0.023604 Jun 22 18:48:50.735091 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 531/1109] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jun 22 18:48:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-708331976 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:48:51.084222 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-276c51d3-f4a1-48cc-8f1a-e75f8348de55 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:51.084839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-276c51d3-f4a1-48cc-8f1a-e75f8348de55 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:51.088444 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:51.092924 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-276c51d3-f4a1-48cc-8f1a-e75f8348de55 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:51.093381 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-276c51d3-f4a1-48cc-8f1a-e75f8348de55 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:51.094226 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-276c51d3-f4a1-48cc-8f1a-e75f8348de55 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:51.095134 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-276c51d3-f4a1-48cc-8f1a-e75f8348de55 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:51.100734 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:51.241859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-276c51d3-f4a1-48cc-8f1a-e75f8348de55 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:51.249569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-276c51d3-f4a1-48cc-8f1a-e75f8348de55 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1318 microversion: 2.1 time: 0.169322 Jun 22 18:48:51.250420 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 579/1110] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:51 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:48:51.409920 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1690788d-1a79-4712-9b90-9ea44a72882e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Action: 'create', calling method: .version_select at 0x7fd7555e9ca0>, body: {"keypair": {"name": "tempest-keypair-2124317988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjTawxb24cs0DCgYlYyOxDs/SAVF2VUbHiV7LMG8zxfuxi0YT+SCNRBzFmrCCQ45/mIksY+8wFs86ceY9EJqcRp9LZG/dZO93YbdlPvFq1wGDxDaiaglY9uaGvX4sV/DQ=="}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:48:51.423956 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-1690788d-1a79-4712-9b90-9ea44a72882e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:48:51.428879 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-1690788d-1a79-4712-9b90-9ea44a72882e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for user bfa74308096d40daac0a67c9ebec8d8d and project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:48:51.451009 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1690788d-1a79-4712-9b90-9ea44a72882e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046288 Jun 22 18:48:51.452182 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 532/1111] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 18:48:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:52.267656 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7e87c7b8-f07b-493d-b2f6-4c8403eab1a0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:52.269122 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7e87c7b8-f07b-493d-b2f6-4c8403eab1a0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:52.277978 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7e87c7b8-f07b-493d-b2f6-4c8403eab1a0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:52.279064 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7e87c7b8-f07b-493d-b2f6-4c8403eab1a0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:52.281164 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7e87c7b8-f07b-493d-b2f6-4c8403eab1a0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:52.281611 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7e87c7b8-f07b-493d-b2f6-4c8403eab1a0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:52.529002 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7e87c7b8-f07b-493d-b2f6-4c8403eab1a0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:52.537328 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7e87c7b8-f07b-493d-b2f6-4c8403eab1a0 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1507 microversion: 2.1 time: 0.274630 Jun 22 18:48:52.538147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 580/1112] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:52 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:52.556507 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f4760371-ea07-4992-a4d8-e8ebe0141e2d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "878aa4fc-0159-46c1-a051-5240534da129", "device": "/dev/sdb"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:48:52.557594 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f4760371-ea07-4992-a4d8-e8ebe0141e2d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:52.565515 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f4760371-ea07-4992-a4d8-e8ebe0141e2d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:52.565967 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f4760371-ea07-4992-a4d8-e8ebe0141e2d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:52.566748 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f4760371-ea07-4992-a4d8-e8ebe0141e2d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:52.567179 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f4760371-ea07-4992-a4d8-e8ebe0141e2d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:52.847178 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f4760371-ea07-4992-a4d8-e8ebe0141e2d tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "POST /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294870 Jun 22 18:48:52.858938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 533/1113] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:48:52 2022] POST /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:53.117194 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1569350932", "imageRef": "f77c9ec1-6604-4af2-b079-6b40bc7e84b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22c9b457-d574-4ec6-85ed-412ef1688a3f"}], "security_groups": [{"name": "tempest-securitygroup--481302232"}], "key_name": "tempest-keypair-2124317988", "user_data": "}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:48:53.230102 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.network.neutron [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] validate_networks() for [('22c9b457-d574-4ec6-85ed-412ef1688a3f', None, None, None, None, None)] {{(pid=129744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:48:53.886040 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Flavor limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:48:53.886605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Image limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:48:53.887083 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Flavor pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:48:53.888266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Image pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:48:53.888863 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:48:53.898648 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:53.899253 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:53.900194 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:53.900642 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:53.920042 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:48:53.924545 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Getting quotas for user bfa74308096d40daac0a67c9ebec8d8d and project 28351bd81f5f497a829c67c15bbb2f09. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:48:53.936052 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Going to run 1 instances... {{(pid=129744) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:48:53.938995 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f77c9ec1-6604-4af2-b079-6b40bc7e84b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:48:54.006611 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-933b8f33-26a0-4a1c-bf10-f3749702993a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.890072 Jun 22 18:48:54.007218 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 581/1114] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:48:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:48:54.018892 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-fdee21ce-01b0-425b-8e93-85859cf705e9 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:54.020398 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-fdee21ce-01b0-425b-8e93-85859cf705e9 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:54.102318 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-fdee21ce-01b0-425b-8e93-85859cf705e9 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:54.109980 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-fdee21ce-01b0-425b-8e93-85859cf705e9 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1242 microversion: 2.1 time: 0.097004 Jun 22 18:48:54.110713 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 534/1115] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:54 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:48:55.128591 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-139de080-ee52-4b14-ac45-8c72e9f4ec87 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:55.130103 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-139de080-ee52-4b14-ac45-8c72e9f4ec87 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:55.137228 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-139de080-ee52-4b14-ac45-8c72e9f4ec87 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:55.138002 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-139de080-ee52-4b14-ac45-8c72e9f4ec87 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:55.140185 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-139de080-ee52-4b14-ac45-8c72e9f4ec87 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:55.140723 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-139de080-ee52-4b14-ac45-8c72e9f4ec87 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:55.216125 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-139de080-ee52-4b14-ac45-8c72e9f4ec87 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:55.224946 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-139de080-ee52-4b14-ac45-8c72e9f4ec87 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1300 microversion: 2.1 time: 0.102178 Jun 22 18:48:55.225834 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 582/1116] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:55 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:56.243026 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c5aa2113-e804-4bbf-baac-d76694b5dd49 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:56.243744 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c5aa2113-e804-4bbf-baac-d76694b5dd49 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:56.253539 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c5aa2113-e804-4bbf-baac-d76694b5dd49 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:56.254144 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c5aa2113-e804-4bbf-baac-d76694b5dd49 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:56.255025 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c5aa2113-e804-4bbf-baac-d76694b5dd49 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:56.255579 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c5aa2113-e804-4bbf-baac-d76694b5dd49 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:56.454478 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c5aa2113-e804-4bbf-baac-d76694b5dd49 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:56.463311 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c5aa2113-e804-4bbf-baac-d76694b5dd49 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.224761 Jun 22 18:48:56.463912 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 535/1117] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:56 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:56.688276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-a407ca03-914a-4953-9f7a-efea4471a7dd req-03a92852-6d27-409d-9223-2b7b0f83a6ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d1f61d6-8ef7-4c84-8cc4-f38d1431084a", "tag": "47b9f716-3d48-4026-a37b-1ea54f9474dd"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:48:56.697280 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-a407ca03-914a-4953-9f7a-efea4471a7dd req-03a92852-6d27-409d-9223-2b7b0f83a6ae service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:56.697967 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-a407ca03-914a-4953-9f7a-efea4471a7dd req-03a92852-6d27-409d-9223-2b7b0f83a6ae service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:56.712115 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-a407ca03-914a-4953-9f7a-efea4471a7dd req-03a92852-6d27-409d-9223-2b7b0f83a6ae service nova] Creating event network-changed:47b9f716-3d48-4026-a37b-1ea54f9474dd for instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a on hv-cinder-81268 Jun 22 18:48:56.717641 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-a407ca03-914a-4953-9f7a-efea4471a7dd req-03a92852-6d27-409d-9223-2b7b0f83a6ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189235 Jun 22 18:48:56.719091 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 583/1118] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:48:56.914540 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d930f69e-cb5f-4fd3-ac71-5d073b379761 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:56.915550 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d930f69e-cb5f-4fd3-ac71-5d073b379761 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:56.923009 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d930f69e-cb5f-4fd3-ac71-5d073b379761 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:56.923536 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d930f69e-cb5f-4fd3-ac71-5d073b379761 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:56.924455 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d930f69e-cb5f-4fd3-ac71-5d073b379761 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:56.924967 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d930f69e-cb5f-4fd3-ac71-5d073b379761 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:56.956597 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d930f69e-cb5f-4fd3-ac71-5d073b379761 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046162 Jun 22 18:48:56.957176 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 536/1119] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jun 22 18:48:56 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:57.020398 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a6f8f946-67d5-49eb-be34-1ed173fc46ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:57.020982 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a6f8f946-67d5-49eb-be34-1ed173fc46ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:57.027261 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a6f8f946-67d5-49eb-be34-1ed173fc46ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:57.027650 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a6f8f946-67d5-49eb-be34-1ed173fc46ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:57.028438 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a6f8f946-67d5-49eb-be34-1ed173fc46ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:57.028889 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a6f8f946-67d5-49eb-be34-1ed173fc46ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:57.061909 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a6f8f946-67d5-49eb-be34-1ed173fc46ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Going to try to terminate instance {{(pid=129744) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:48:57.139690 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a6f8f946-67d5-49eb-be34-1ed173fc46ca tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "DELETE /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 204 len: 0 microversion: 2.20 time: 0.123050 Jun 22 18:48:57.140372 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 584/1120] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jun 22 18:48:57 2022] DELETE /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 18:48:57.149020 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-48b9425c-b30d-4e0f-ba93-0e112282a207 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:57.149646 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-48b9425c-b30d-4e0f-ba93-0e112282a207 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:57.155635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-48b9425c-b30d-4e0f-ba93-0e112282a207 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:57.156107 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-48b9425c-b30d-4e0f-ba93-0e112282a207 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:57.156857 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-48b9425c-b30d-4e0f-ba93-0e112282a207 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:57.157285 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-48b9425c-b30d-4e0f-ba93-0e112282a207 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:57.283744 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-48b9425c-b30d-4e0f-ba93-0e112282a207 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:57.291607 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-48b9425c-b30d-4e0f-ba93-0e112282a207 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:57.293182 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-48b9425c-b30d-4e0f-ba93-0e112282a207 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:57.294326 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-48b9425c-b30d-4e0f-ba93-0e112282a207 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.149242 Jun 22 18:48:57.294884 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 537/1121] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:48:57 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:48:57.480977 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d799dabc-0c83-48a6-a746-8709bbc9d9fd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:57.481666 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d799dabc-0c83-48a6-a746-8709bbc9d9fd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:57.488500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d799dabc-0c83-48a6-a746-8709bbc9d9fd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:57.488943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d799dabc-0c83-48a6-a746-8709bbc9d9fd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:57.489700 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d799dabc-0c83-48a6-a746-8709bbc9d9fd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:57.490127 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d799dabc-0c83-48a6-a746-8709bbc9d9fd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:57.625176 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d799dabc-0c83-48a6-a746-8709bbc9d9fd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:57.632884 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d799dabc-0c83-48a6-a746-8709bbc9d9fd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.156129 Jun 22 18:48:57.633443 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 585/1122] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:57 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:58.313942 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-29d7600a-28f7-43d4-869a-049648c9ff35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:58.314555 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-29d7600a-28f7-43d4-869a-049648c9ff35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:58.322505 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-29d7600a-28f7-43d4-869a-049648c9ff35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:58.322957 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-29d7600a-28f7-43d4-869a-049648c9ff35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:58.323726 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-29d7600a-28f7-43d4-869a-049648c9ff35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:58.324190 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-29d7600a-28f7-43d4-869a-049648c9ff35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:58.343974 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:48:58.464650 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-29d7600a-28f7-43d4-869a-049648c9ff35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:58.472644 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-29d7600a-28f7-43d4-869a-049648c9ff35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:58.474181 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-29d7600a-28f7-43d4-869a-049648c9ff35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:58.475317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-29d7600a-28f7-43d4-869a-049648c9ff35 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.165949 Jun 22 18:48:58.475892 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 538/1123] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:48:58 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:48:58.649678 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4a044f86-43d5-449c-b2df-a363c9611b46 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:58.650336 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4a044f86-43d5-449c-b2df-a363c9611b46 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:58.656811 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a044f86-43d5-449c-b2df-a363c9611b46 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:58.657253 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a044f86-43d5-449c-b2df-a363c9611b46 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:58.658005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a044f86-43d5-449c-b2df-a363c9611b46 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:58.658432 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a044f86-43d5-449c-b2df-a363c9611b46 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:58.785773 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4a044f86-43d5-449c-b2df-a363c9611b46 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:58.793138 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4a044f86-43d5-449c-b2df-a363c9611b46 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.147397 Jun 22 18:48:58.793687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 586/1124] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:58 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:48:59.493833 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c4c47c2a-6443-4d21-898f-f6d16e3ddd15 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:59.494443 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c4c47c2a-6443-4d21-898f-f6d16e3ddd15 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:59.501686 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c4c47c2a-6443-4d21-898f-f6d16e3ddd15 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:59.502389 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c4c47c2a-6443-4d21-898f-f6d16e3ddd15 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:59.503148 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c4c47c2a-6443-4d21-898f-f6d16e3ddd15 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:59.503574 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c4c47c2a-6443-4d21-898f-f6d16e3ddd15 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:59.632709 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c4c47c2a-6443-4d21-898f-f6d16e3ddd15 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:59.641426 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c4c47c2a-6443-4d21-898f-f6d16e3ddd15 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:59.642930 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c4c47c2a-6443-4d21-898f-f6d16e3ddd15 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:59.644120 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c4c47c2a-6443-4d21-898f-f6d16e3ddd15 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.154333 Jun 22 18:48:59.644712 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 539/1125] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:48:59 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:48:59.810234 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5941278c-e693-491e-9242-bf137ce82159 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:48:59.811931 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5941278c-e693-491e-9242-bf137ce82159 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:48:59.818424 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5941278c-e693-491e-9242-bf137ce82159 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:59.818881 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5941278c-e693-491e-9242-bf137ce82159 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:59.819650 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5941278c-e693-491e-9242-bf137ce82159 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:48:59.820109 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5941278c-e693-491e-9242-bf137ce82159 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:48:59.950425 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5941278c-e693-491e-9242-bf137ce82159 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:48:59.959387 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5941278c-e693-491e-9242-bf137ce82159 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.152597 Jun 22 18:48:59.959814 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 587/1126] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:48:59 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:49:00.662801 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-097ccad9-865b-46fe-8398-c210ef0350b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:00.663339 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-097ccad9-865b-46fe-8398-c210ef0350b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:00.669965 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-097ccad9-865b-46fe-8398-c210ef0350b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:00.670419 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-097ccad9-865b-46fe-8398-c210ef0350b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:00.671342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-097ccad9-865b-46fe-8398-c210ef0350b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:00.671783 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-097ccad9-865b-46fe-8398-c210ef0350b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:00.803676 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-097ccad9-865b-46fe-8398-c210ef0350b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:00.812434 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-097ccad9-865b-46fe-8398-c210ef0350b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:00.813972 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-097ccad9-865b-46fe-8398-c210ef0350b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:00.815174 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-097ccad9-865b-46fe-8398-c210ef0350b4 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.156517 Jun 22 18:49:00.815745 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 540/1127] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:49:00 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:49:00.976409 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6afb635c-22c6-4d52-9abc-80f659230fcb tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:00.976980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6afb635c-22c6-4d52-9abc-80f659230fcb tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:00.984127 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6afb635c-22c6-4d52-9abc-80f659230fcb tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:00.984581 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6afb635c-22c6-4d52-9abc-80f659230fcb tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:00.985534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6afb635c-22c6-4d52-9abc-80f659230fcb tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:00.985778 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6afb635c-22c6-4d52-9abc-80f659230fcb tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:01.117327 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6afb635c-22c6-4d52-9abc-80f659230fcb tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:01.125418 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6afb635c-22c6-4d52-9abc-80f659230fcb tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.153140 Jun 22 18:49:01.125982 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 588/1128] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:00 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:49:01.833993 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-13570b9d-1447-4f72-bef6-7c1c863a51d1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:01.834594 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-13570b9d-1447-4f72-bef6-7c1c863a51d1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:01.841368 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-13570b9d-1447-4f72-bef6-7c1c863a51d1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:01.841865 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-13570b9d-1447-4f72-bef6-7c1c863a51d1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:01.843524 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-13570b9d-1447-4f72-bef6-7c1c863a51d1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:01.844023 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-13570b9d-1447-4f72-bef6-7c1c863a51d1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:01.969887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-13570b9d-1447-4f72-bef6-7c1c863a51d1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:01.977863 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-13570b9d-1447-4f72-bef6-7c1c863a51d1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:01.979479 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-13570b9d-1447-4f72-bef6-7c1c863a51d1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:01.980775 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-13570b9d-1447-4f72-bef6-7c1c863a51d1 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.150780 Jun 22 18:49:01.981390 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 541/1129] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:49:01 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:49:02.143227 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f4a01579-a669-4cdc-8031-4f25aa119aec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:02.143872 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f4a01579-a669-4cdc-8031-4f25aa119aec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:02.150367 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f4a01579-a669-4cdc-8031-4f25aa119aec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:02.150812 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f4a01579-a669-4cdc-8031-4f25aa119aec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:02.151586 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f4a01579-a669-4cdc-8031-4f25aa119aec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:02.152045 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f4a01579-a669-4cdc-8031-4f25aa119aec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:02.283339 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f4a01579-a669-4cdc-8031-4f25aa119aec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:02.290786 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f4a01579-a669-4cdc-8031-4f25aa119aec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.152341 Jun 22 18:49:02.291344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 589/1130] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:02 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:49:02.999086 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f1d7c4cd-5cb7-4fe6-8777-4e37da870b26 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:02.999797 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f1d7c4cd-5cb7-4fe6-8777-4e37da870b26 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:03.006655 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f1d7c4cd-5cb7-4fe6-8777-4e37da870b26 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:03.007090 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f1d7c4cd-5cb7-4fe6-8777-4e37da870b26 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:03.007858 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f1d7c4cd-5cb7-4fe6-8777-4e37da870b26 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:03.008289 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f1d7c4cd-5cb7-4fe6-8777-4e37da870b26 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:03.140231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f1d7c4cd-5cb7-4fe6-8777-4e37da870b26 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:03.148167 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f1d7c4cd-5cb7-4fe6-8777-4e37da870b26 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:03.149761 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-f1d7c4cd-5cb7-4fe6-8777-4e37da870b26 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:03.150986 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f1d7c4cd-5cb7-4fe6-8777-4e37da870b26 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.156384 Jun 22 18:49:03.151717 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 542/1131] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:49:02 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:49:03.308881 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5053b4e0-2be4-454e-9739-565e818505ec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:03.309459 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5053b4e0-2be4-454e-9739-565e818505ec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:03.320331 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5053b4e0-2be4-454e-9739-565e818505ec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:03.320331 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5053b4e0-2be4-454e-9739-565e818505ec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:03.320331 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5053b4e0-2be4-454e-9739-565e818505ec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:03.320331 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5053b4e0-2be4-454e-9739-565e818505ec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:03.460264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5053b4e0-2be4-454e-9739-565e818505ec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:03.467996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5053b4e0-2be4-454e-9739-565e818505ec tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.163530 Jun 22 18:49:03.468551 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 590/1132] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:03 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:49:04.169722 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2c45af1e-3704-4b5d-9ed9-b9816617f1a3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:04.170333 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2c45af1e-3704-4b5d-9ed9-b9816617f1a3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:04.172657 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=6 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:04.178096 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2c45af1e-3704-4b5d-9ed9-b9816617f1a3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:04.178545 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2c45af1e-3704-4b5d-9ed9-b9816617f1a3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:04.179311 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2c45af1e-3704-4b5d-9ed9-b9816617f1a3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:04.179750 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2c45af1e-3704-4b5d-9ed9-b9816617f1a3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:04.308705 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2c45af1e-3704-4b5d-9ed9-b9816617f1a3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:04.317180 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2c45af1e-3704-4b5d-9ed9-b9816617f1a3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:04.318708 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2c45af1e-3704-4b5d-9ed9-b9816617f1a3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:04.319873 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2c45af1e-3704-4b5d-9ed9-b9816617f1a3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.154101 Jun 22 18:49:04.320440 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 543/1133] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:49:04 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:49:04.483263 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f88d1465-3d04-40f2-bfe5-bfe14fd530e2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:04.484325 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f88d1465-3d04-40f2-bfe5-bfe14fd530e2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:04.486031 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:04.486746 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=6 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:04.493028 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f88d1465-3d04-40f2-bfe5-bfe14fd530e2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:04.493470 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f88d1465-3d04-40f2-bfe5-bfe14fd530e2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:04.494241 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f88d1465-3d04-40f2-bfe5-bfe14fd530e2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:04.494669 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f88d1465-3d04-40f2-bfe5-bfe14fd530e2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:04.642527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f88d1465-3d04-40f2-bfe5-bfe14fd530e2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:04.649900 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f88d1465-3d04-40f2-bfe5-bfe14fd530e2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.170432 Jun 22 18:49:04.650454 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 591/1134] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:04 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:49:05.338778 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-dda70046-b24a-4e12-b7a9-e27769820c50 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:05.339383 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-dda70046-b24a-4e12-b7a9-e27769820c50 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:05.346226 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dda70046-b24a-4e12-b7a9-e27769820c50 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:05.346679 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dda70046-b24a-4e12-b7a9-e27769820c50 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:05.347449 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dda70046-b24a-4e12-b7a9-e27769820c50 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:05.347923 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-dda70046-b24a-4e12-b7a9-e27769820c50 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:05.476211 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-dda70046-b24a-4e12-b7a9-e27769820c50 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:05.484835 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-dda70046-b24a-4e12-b7a9-e27769820c50 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:05.486359 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-dda70046-b24a-4e12-b7a9-e27769820c50 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:05.487511 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-dda70046-b24a-4e12-b7a9-e27769820c50 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.152652 Jun 22 18:49:05.488105 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 544/1135] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:49:05 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:49:05.667101 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-754f644f-50a8-474c-a40f-f43f08028706 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:05.668565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-754f644f-50a8-474c-a40f-f43f08028706 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:05.676570 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-754f644f-50a8-474c-a40f-f43f08028706 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:05.677442 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-754f644f-50a8-474c-a40f-f43f08028706 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:05.678612 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-754f644f-50a8-474c-a40f-f43f08028706 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:05.679142 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-754f644f-50a8-474c-a40f-f43f08028706 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:05.829542 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-754f644f-50a8-474c-a40f-f43f08028706 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:05.837461 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-754f644f-50a8-474c-a40f-f43f08028706 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.174562 Jun 22 18:49:05.838655 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 592/1136] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:05 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:49:06.515348 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4e4b66b7-da0a-489c-84eb-6d8ad79eca9c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:06.519801 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-4e4b66b7-da0a-489c-84eb-6d8ad79eca9c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:06.536473 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4e4b66b7-da0a-489c-84eb-6d8ad79eca9c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:06.538795 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4e4b66b7-da0a-489c-84eb-6d8ad79eca9c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:06.539892 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4e4b66b7-da0a-489c-84eb-6d8ad79eca9c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:06.540782 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4e4b66b7-da0a-489c-84eb-6d8ad79eca9c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:06.865880 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2056cf39-f90f-43c6-8a67-f2f9eed128bc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:06.866725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2056cf39-f90f-43c6-8a67-f2f9eed128bc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:06.884313 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2056cf39-f90f-43c6-8a67-f2f9eed128bc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:06.884944 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2056cf39-f90f-43c6-8a67-f2f9eed128bc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:06.885802 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2056cf39-f90f-43c6-8a67-f2f9eed128bc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:06.886419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2056cf39-f90f-43c6-8a67-f2f9eed128bc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:07.140261 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-2056cf39-f90f-43c6-8a67-f2f9eed128bc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:07.150566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2056cf39-f90f-43c6-8a67-f2f9eed128bc tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.299848 Jun 22 18:49:07.151537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 593/1137] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:06 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:49:07.182123 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4e4b66b7-da0a-489c-84eb-6d8ad79eca9c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:07.192735 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4e4b66b7-da0a-489c-84eb-6d8ad79eca9c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:07.194400 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4e4b66b7-da0a-489c-84eb-6d8ad79eca9c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:07.195848 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4e4b66b7-da0a-489c-84eb-6d8ad79eca9c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1726 microversion: 2.20 time: 0.693644 Jun 22 18:49:07.207690 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 545/1138] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:49:06 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1726 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:49:07.996797 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-1ed669c9-495f-412b-9ce3-ab20241c13f7 req-88115885-7da1-48b8-934b-3fc310dd1440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63daf967-ba4f-4773-92e1-ac70bc58330a", "name": "network-vif-deleted", "tag": "d6614812-103b-4720-9cea-4cef6882458e"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:49:08.006602 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-1ed669c9-495f-412b-9ce3-ab20241c13f7 req-88115885-7da1-48b8-934b-3fc310dd1440 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:08.007041 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-1ed669c9-495f-412b-9ce3-ab20241c13f7 req-88115885-7da1-48b8-934b-3fc310dd1440 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:08.018444 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-1ed669c9-495f-412b-9ce3-ab20241c13f7 req-88115885-7da1-48b8-934b-3fc310dd1440 service nova] Creating event network-vif-deleted:d6614812-103b-4720-9cea-4cef6882458e for instance 63daf967-ba4f-4773-92e1-ac70bc58330a on hv-cinder-81268 Jun 22 18:49:08.023814 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-1ed669c9-495f-412b-9ce3-ab20241c13f7 req-88115885-7da1-48b8-934b-3fc310dd1440 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032334 Jun 22 18:49:08.024636 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 594/1139] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:49:08.168892 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-727b3919-7019-4f6f-b14a-da5c45724b24 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:08.170103 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-727b3919-7019-4f6f-b14a-da5c45724b24 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:08.179677 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-727b3919-7019-4f6f-b14a-da5c45724b24 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:08.180277 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-727b3919-7019-4f6f-b14a-da5c45724b24 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:08.181392 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-727b3919-7019-4f6f-b14a-da5c45724b24 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:08.182280 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-727b3919-7019-4f6f-b14a-da5c45724b24 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:08.217188 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ee0481c0-2db9-4e8e-b101-e07146ec97f2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:08.219537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ee0481c0-2db9-4e8e-b101-e07146ec97f2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:08.238409 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ee0481c0-2db9-4e8e-b101-e07146ec97f2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:08.239274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ee0481c0-2db9-4e8e-b101-e07146ec97f2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:08.240269 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ee0481c0-2db9-4e8e-b101-e07146ec97f2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:08.241303 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ee0481c0-2db9-4e8e-b101-e07146ec97f2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:08.329490 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ee0481c0-2db9-4e8e-b101-e07146ec97f2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:08.338374 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ee0481c0-2db9-4e8e-b101-e07146ec97f2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:08.340396 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ee0481c0-2db9-4e8e-b101-e07146ec97f2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:08.341741 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ee0481c0-2db9-4e8e-b101-e07146ec97f2 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1658 microversion: 2.20 time: 0.130858 Jun 22 18:49:08.342890 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 595/1140] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:49:08 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1658 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:49:08.353215 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-727b3919-7019-4f6f-b14a-da5c45724b24 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:08.361318 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-727b3919-7019-4f6f-b14a-da5c45724b24 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.196538 Jun 22 18:49:08.362121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 546/1141] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:08 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:49:09.361024 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b4d628a8-cb27-46d5-accf-6dea8f3f38c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:09.361713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b4d628a8-cb27-46d5-accf-6dea8f3f38c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:09.368235 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b4d628a8-cb27-46d5-accf-6dea8f3f38c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:09.368765 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b4d628a8-cb27-46d5-accf-6dea8f3f38c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:09.369522 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b4d628a8-cb27-46d5-accf-6dea8f3f38c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:09.369949 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b4d628a8-cb27-46d5-accf-6dea8f3f38c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:09.375601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:09.381029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b235a272-581d-4f39-98c9-c45f27d66291 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:09.382457 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b235a272-581d-4f39-98c9-c45f27d66291 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:09.390557 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b235a272-581d-4f39-98c9-c45f27d66291 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:09.391463 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b235a272-581d-4f39-98c9-c45f27d66291 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:09.392259 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b235a272-581d-4f39-98c9-c45f27d66291 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:09.392704 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b235a272-581d-4f39-98c9-c45f27d66291 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:09.469910 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b4d628a8-cb27-46d5-accf-6dea8f3f38c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:09.480037 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b4d628a8-cb27-46d5-accf-6dea8f3f38c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:09.481956 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b4d628a8-cb27-46d5-accf-6dea8f3f38c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:09.483946 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b4d628a8-cb27-46d5-accf-6dea8f3f38c7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1658 microversion: 2.20 time: 0.126681 Jun 22 18:49:09.484750 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 596/1142] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:49:09 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1658 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:49:09.544217 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b235a272-581d-4f39-98c9-c45f27d66291 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:09.552302 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b235a272-581d-4f39-98c9-c45f27d66291 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.177209 Jun 22 18:49:09.552955 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 547/1143] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:09 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:49:10.494474 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-3044ea5f-db3e-41d2-9649-13005f30ec0f req-b49a64e2-8c10-4364-b282-47fd004e7750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1f61d6-8ef7-4c84-8cc4-f38d1431084a", "name": "network-vif-plugged", "status": "completed", "tag": "47b9f716-3d48-4026-a37b-1ea54f9474dd"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:49:10.505440 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-3044ea5f-db3e-41d2-9649-13005f30ec0f req-b49a64e2-8c10-4364-b282-47fd004e7750 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:10.506022 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3bd3adf3-78f9-4b34-b808-56556d634fd9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:10.506737 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-3044ea5f-db3e-41d2-9649-13005f30ec0f req-b49a64e2-8c10-4364-b282-47fd004e7750 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:10.506915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3bd3adf3-78f9-4b34-b808-56556d634fd9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:10.513530 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3bd3adf3-78f9-4b34-b808-56556d634fd9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:10.514047 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3bd3adf3-78f9-4b34-b808-56556d634fd9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:10.515373 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3bd3adf3-78f9-4b34-b808-56556d634fd9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:10.516188 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3bd3adf3-78f9-4b34-b808-56556d634fd9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:10.524380 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-3044ea5f-db3e-41d2-9649-13005f30ec0f req-b49a64e2-8c10-4364-b282-47fd004e7750 service nova] Creating event network-vif-plugged:47b9f716-3d48-4026-a37b-1ea54f9474dd for instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a on hv-cinder-81268 Jun 22 18:49:10.529277 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-3044ea5f-db3e-41d2-9649-13005f30ec0f req-b49a64e2-8c10-4364-b282-47fd004e7750 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038496 Jun 22 18:49:10.530746 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 597/1144] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:49:10.571566 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9f70d0b2-2cb6-468e-9cda-95c9479fe3db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:10.582791 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9f70d0b2-2cb6-468e-9cda-95c9479fe3db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:10.588489 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3bd3adf3-78f9-4b34-b808-56556d634fd9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:10.594022 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9f70d0b2-2cb6-468e-9cda-95c9479fe3db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:10.594707 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9f70d0b2-2cb6-468e-9cda-95c9479fe3db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:10.595491 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9f70d0b2-2cb6-468e-9cda-95c9479fe3db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:10.595962 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9f70d0b2-2cb6-468e-9cda-95c9479fe3db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:10.598242 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3bd3adf3-78f9-4b34-b808-56556d634fd9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:10.599993 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3bd3adf3-78f9-4b34-b808-56556d634fd9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:10.602555 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3bd3adf3-78f9-4b34-b808-56556d634fd9 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1658 microversion: 2.20 time: 0.103104 Jun 22 18:49:10.603873 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 548/1145] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:49:10 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1658 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 18:49:10.735322 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9f70d0b2-2cb6-468e-9cda-95c9479fe3db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:10.742816 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9f70d0b2-2cb6-468e-9cda-95c9479fe3db tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.176919 Jun 22 18:49:10.743461 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 598/1146] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:10 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:49:11.621956 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-71712a6a-baaa-4d98-81ef-da890c39d49f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:11.622572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-71712a6a-baaa-4d98-81ef-da890c39d49f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:11.632935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71712a6a-baaa-4d98-81ef-da890c39d49f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:11.638651 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71712a6a-baaa-4d98-81ef-da890c39d49f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:11.640306 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71712a6a-baaa-4d98-81ef-da890c39d49f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:11.640704 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-71712a6a-baaa-4d98-81ef-da890c39d49f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:11.732430 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-71712a6a-baaa-4d98-81ef-da890c39d49f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:11.746377 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-71712a6a-baaa-4d98-81ef-da890c39d49f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:11.751020 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-71712a6a-baaa-4d98-81ef-da890c39d49f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8978ed54252843f78b0d00d37b475ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1ef211ea584b0abd50b02208966d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:11.753777 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-71712a6a-baaa-4d98-81ef-da890c39d49f tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 200 len: 1367 microversion: 2.20 time: 0.134878 Jun 22 18:49:11.766509 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 549/1147] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:49:11 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 18:49:11.774810 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a0162e52-6683-4f69-9949-da2b4d00a0c2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:11.774810 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a0162e52-6683-4f69-9949-da2b4d00a0c2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:11.783401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a0162e52-6683-4f69-9949-da2b4d00a0c2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:11.784327 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a0162e52-6683-4f69-9949-da2b4d00a0c2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:11.785356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a0162e52-6683-4f69-9949-da2b4d00a0c2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:11.785834 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a0162e52-6683-4f69-9949-da2b4d00a0c2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:11.937984 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-a0162e52-6683-4f69-9949-da2b4d00a0c2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:11.946688 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a0162e52-6683-4f69-9949-da2b4d00a0c2 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.178763 Jun 22 18:49:11.946688 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 599/1148] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:11 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:49:12.773762 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f35b21ac-e6d9-453f-9971-477aeb21ea2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:12.775041 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f35b21ac-e6d9-453f-9971-477aeb21ea2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:12.783192 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f35b21ac-e6d9-453f-9971-477aeb21ea2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:12.783633 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f35b21ac-e6d9-453f-9971-477aeb21ea2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:12.784591 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f35b21ac-e6d9-453f-9971-477aeb21ea2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:12.785086 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f35b21ac-e6d9-453f-9971-477aeb21ea2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:12.799592 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-f35b21ac-e6d9-453f-9971-477aeb21ea2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] HTTP exception thrown: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f35b21ac-e6d9-453f-9971-477aeb21ea2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Request method failure captured: Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a HTTP/1.1 Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GMNVVijv6NFrZXVk60QuvtN4TVQ9Cc-S-SaR6g-aSlefiS2lHfhM-yCKj-50B3bn-mxIDEKPapluuF_DwUMwyg1STapeS4ocHStk3bSjCpmQCMLEX_2aMyoz4OqNKVgnIxzVKL4lIWpZg1p7BARHUWtjVuyk0CFlk3258Hj2BxQRc Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: bd1ef211ea584b0abd50b02208966d7a Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:49:12.801267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:49:12.802990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bd1ef211ea584b0abd50b02208966d7a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:49:12.802990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:12.802990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: bd1ef211ea584b0abd50b02208966d7a Jun 22 18:49:12.802990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:12.802990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeShelveTestJSON-1352239561-project Jun 22 18:49:12.802990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:49:12.802990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:49:12.802990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 8978ed54252843f78b0d00d37b475ad2 Jun 22 18:49:12.802990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1352239561-project Jun 22 18:49:12.802990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:49:12.802990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:12.802990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '63daf967-ba4f-4773-92e1-ac70bc58330a'} Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:49:12.803935 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:12.805474 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:12.807601 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f35b21ac-e6d9-453f-9971-477aeb21ea2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Returning 404 to user: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:49:12.808705 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f35b21ac-e6d9-453f-9971-477aeb21ea2c tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 404 len: 111 microversion: 2.20 time: 0.039946 Jun 22 18:49:12.809283 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 550/1149] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:49:12 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 18:49:12.818885 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-023339dc-5fab-4510-a4ea-eec986123195 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '.version_select at 0x7fd75544ef70>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:12.838298 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-023339dc-5fab-4510-a4ea-eec986123195 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1606041215" status: 204 len: 0 microversion: 2.20 time: 0.023674 Jun 22 18:49:12.838868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 600/1150] 10.222.0.18 () {60 vars in 1261 bytes} [Wed Jun 22 18:49:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1606041215 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 18:49:12.961405 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5058fb49-f05f-4540-bdf5-673e0a6ee1e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:12.962083 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5058fb49-f05f-4540-bdf5-673e0a6ee1e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:12.968933 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5058fb49-f05f-4540-bdf5-673e0a6ee1e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:12.969379 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5058fb49-f05f-4540-bdf5-673e0a6ee1e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:12.970155 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5058fb49-f05f-4540-bdf5-673e0a6ee1e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:12.970583 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5058fb49-f05f-4540-bdf5-673e0a6ee1e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:13.144472 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5058fb49-f05f-4540-bdf5-673e0a6ee1e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:13.152135 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5058fb49-f05f-4540-bdf5-673e0a6ee1e3 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.194500 Jun 22 18:49:13.152884 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 551/1151] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:12 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:49:14.169453 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4c4ccf9a-d02c-4066-b576-74898c3286f6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:14.170057 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4c4ccf9a-d02c-4066-b576-74898c3286f6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:14.177376 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4c4ccf9a-d02c-4066-b576-74898c3286f6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:14.177795 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4c4ccf9a-d02c-4066-b576-74898c3286f6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:14.178554 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4c4ccf9a-d02c-4066-b576-74898c3286f6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:14.178986 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4c4ccf9a-d02c-4066-b576-74898c3286f6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:14.323470 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4c4ccf9a-d02c-4066-b576-74898c3286f6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:14.332038 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4c4ccf9a-d02c-4066-b576-74898c3286f6 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1367 microversion: 2.1 time: 0.166396 Jun 22 18:49:14.332684 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 601/1152] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:14 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:49:15.349326 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e4cfe4ff-a25b-41b0-8db0-add96560139a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:15.349922 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e4cfe4ff-a25b-41b0-8db0-add96560139a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:15.356784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e4cfe4ff-a25b-41b0-8db0-add96560139a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:15.357229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e4cfe4ff-a25b-41b0-8db0-add96560139a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:15.357991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e4cfe4ff-a25b-41b0-8db0-add96560139a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:15.359729 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e4cfe4ff-a25b-41b0-8db0-add96560139a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:15.486160 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e4cfe4ff-a25b-41b0-8db0-add96560139a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:15.493579 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e4cfe4ff-a25b-41b0-8db0-add96560139a tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1557 microversion: 2.1 time: 0.148162 Jun 22 18:49:15.494138 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 552/1153] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:15 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:49:15.510346 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e842c3b5-ab8b-4a1b-ad67-39bbd9026338 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:15.510892 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e842c3b5-ab8b-4a1b-ad67-39bbd9026338 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:15.517950 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e842c3b5-ab8b-4a1b-ad67-39bbd9026338 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:15.518394 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e842c3b5-ab8b-4a1b-ad67-39bbd9026338 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:15.519148 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e842c3b5-ab8b-4a1b-ad67-39bbd9026338 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:15.519578 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e842c3b5-ab8b-4a1b-ad67-39bbd9026338 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:15.597863 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e842c3b5-ab8b-4a1b-ad67-39bbd9026338 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091276 Jun 22 18:49:15.598449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 602/1154] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 22 18:49:15 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:49:16.629492 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-922ee096-05b6-4d41-b12c-8d9488c19aa4 req-9f343380-e010-4cf9-a47f-d7cacf0cfe9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d1f61d6-8ef7-4c84-8cc4-f38d1431084a", "tag": "47b9f716-3d48-4026-a37b-1ea54f9474dd"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:49:16.637638 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-922ee096-05b6-4d41-b12c-8d9488c19aa4 req-9f343380-e010-4cf9-a47f-d7cacf0cfe9a service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:16.638081 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-922ee096-05b6-4d41-b12c-8d9488c19aa4 req-9f343380-e010-4cf9-a47f-d7cacf0cfe9a service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:16.652434 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-922ee096-05b6-4d41-b12c-8d9488c19aa4 req-9f343380-e010-4cf9-a47f-d7cacf0cfe9a service nova] Creating event network-changed:47b9f716-3d48-4026-a37b-1ea54f9474dd for instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a on hv-cinder-81268 Jun 22 18:49:16.658293 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-922ee096-05b6-4d41-b12c-8d9488c19aa4 req-9f343380-e010-4cf9-a47f-d7cacf0cfe9a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156129 Jun 22 18:49:16.659108 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 553/1155] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:49:19.899337 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-038a4bbe-4ffe-478b-89a4-06b4b280d651 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:19.900000 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-038a4bbe-4ffe-478b-89a4-06b4b280d651 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:19.906697 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-038a4bbe-4ffe-478b-89a4-06b4b280d651 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:19.907232 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-038a4bbe-4ffe-478b-89a4-06b4b280d651 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:19.908594 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-038a4bbe-4ffe-478b-89a4-06b4b280d651 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:19.909171 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-038a4bbe-4ffe-478b-89a4-06b4b280d651 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:19.924393 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-038a4bbe-4ffe-478b-89a4-06b4b280d651 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] HTTP exception thrown: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-038a4bbe-4ffe-478b-89a4-06b4b280d651 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Request method failure captured: Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: DELETE /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a HTTP/1.1 Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2GMNVVijv6NFrZXVk60QuvtN4TVQ9Cc-S-SaR6g-aSlefiS2lHfhM-yCKj-50B3bn-mxIDEKPapluuF_DwUMwyg1STapeS4ocHStk3bSjCpmQCMLEX_2aMyoz4OqNKVgnIxzVKL4lIWpZg1p7BARHUWtjVuyk0CFlk3258Hj2BxQRc Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: bd1ef211ea584b0abd50b02208966d7a Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:49:19.926254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:49:19.927902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bd1ef211ea584b0abd50b02208966d7a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:49:19.927902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:19.927902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: bd1ef211ea584b0abd50b02208966d7a Jun 22 18:49:19.927902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:19.927902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-AttachVolumeShelveTestJSON-1352239561-project Jun 22 18:49:19.927902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:49:19.927902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:49:19.927902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 8978ed54252843f78b0d00d37b475ad2 Jun 22 18:49:19.927902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1352239561-project Jun 22 18:49:19.927902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:49:19.927902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:19.927902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '63daf967-ba4f-4773-92e1-ac70bc58330a'} Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:49:19.928713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:19.929965 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:19.931240 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-038a4bbe-4ffe-478b-89a4-06b4b280d651 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Returning 404 to user: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:49:19.931240 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-038a4bbe-4ffe-478b-89a4-06b4b280d651 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "DELETE /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 404 len: 111 microversion: 2.20 time: 0.033712 Jun 22 18:49:19.931240 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 603/1156] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jun 22 18:49:19 2022] DELETE /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 18:49:19.939420 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f098edc3-9691-4bc7-9f38-6174361302f3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:19.940165 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-f098edc3-9691-4bc7-9f38-6174361302f3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 63daf967-ba4f-4773-92e1-ac70bc58330a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:19.942148 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:19.947924 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f098edc3-9691-4bc7-9f38-6174361302f3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:19.948448 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f098edc3-9691-4bc7-9f38-6174361302f3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:19.949217 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f098edc3-9691-4bc7-9f38-6174361302f3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:19.949645 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-f098edc3-9691-4bc7-9f38-6174361302f3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:19.965306 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-f098edc3-9691-4bc7-9f38-6174361302f3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] HTTP exception thrown: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f098edc3-9691-4bc7-9f38-6174361302f3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Request method failure captured: Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a HTTP/1.1 Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GMNVVijv6NFrZXVk60QuvtN4TVQ9Cc-S-SaR6g-aSlefiS2lHfhM-yCKj-50B3bn-mxIDEKPapluuF_DwUMwyg1STapeS4ocHStk3bSjCpmQCMLEX_2aMyoz4OqNKVgnIxzVKL4lIWpZg1p7BARHUWtjVuyk0CFlk3258Hj2BxQRc Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: bd1ef211ea584b0abd50b02208966d7a Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:49:19.967062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:49:19.968822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bd1ef211ea584b0abd50b02208966d7a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:49:19.968822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:19.968822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: bd1ef211ea584b0abd50b02208966d7a Jun 22 18:49:19.968822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:19.968822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeShelveTestJSON-1352239561-project Jun 22 18:49:19.968822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:49:19.968822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:49:19.968822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 8978ed54252843f78b0d00d37b475ad2 Jun 22 18:49:19.968822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1352239561-project Jun 22 18:49:19.968822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:49:19.968822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:19.968822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '63daf967-ba4f-4773-92e1-ac70bc58330a'} Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:49:19.969700 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. Jun 22 18:49:19.971158 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:19.972559 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-f098edc3-9691-4bc7-9f38-6174361302f3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Returning 404 to user: Instance 63daf967-ba4f-4773-92e1-ac70bc58330a could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:49:19.972559 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-f098edc3-9691-4bc7-9f38-6174361302f3 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a" status: 404 len: 111 microversion: 2.20 time: 0.035179 Jun 22 18:49:19.972559 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 554/1157] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:49:19 2022] GET /compute/v2.1/servers/63daf967-ba4f-4773-92e1-ac70bc58330a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 22 18:49:21.111509 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6cbe4245-99a1-4aff-bcc9-61c67a917be7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:21.112136 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6cbe4245-99a1-4aff-bcc9-61c67a917be7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:21.118936 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6cbe4245-99a1-4aff-bcc9-61c67a917be7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:21.119513 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6cbe4245-99a1-4aff-bcc9-61c67a917be7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:21.120421 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6cbe4245-99a1-4aff-bcc9-61c67a917be7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:21.120966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6cbe4245-99a1-4aff-bcc9-61c67a917be7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:21.135300 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-6cbe4245-99a1-4aff-bcc9-61c67a917be7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] HTTP exception thrown: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6cbe4245-99a1-4aff-bcc9-61c67a917be7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Request method failure captured: Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: DELETE /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 HTTP/1.1 Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2GMNVVijv6NFrZXVk60QuvtN4TVQ9Cc-S-SaR6g-aSlefiS2lHfhM-yCKj-50B3bn-mxIDEKPapluuF_DwUMwyg1STapeS4ocHStk3bSjCpmQCMLEX_2aMyoz4OqNKVgnIxzVKL4lIWpZg1p7BARHUWtjVuyk0CFlk3258Hj2BxQRc Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: bd1ef211ea584b0abd50b02208966d7a Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:49:21.136980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:49:21.138654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bd1ef211ea584b0abd50b02208966d7a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:49:21.138654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:21.138654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: bd1ef211ea584b0abd50b02208966d7a Jun 22 18:49:21.138654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:21.138654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-AttachVolumeShelveTestJSON-1352239561-project Jun 22 18:49:21.138654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:49:21.138654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:49:21.138654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 8978ed54252843f78b0d00d37b475ad2 Jun 22 18:49:21.138654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1352239561-project Jun 22 18:49:21.138654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:49:21.138654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:49:21.138654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '688c6da6-d454-4dc0-8335-b0a4e16f5824'} Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:49:21.140147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:49:21.141632 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:21.143200 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6cbe4245-99a1-4aff-bcc9-61c67a917be7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Returning 404 to user: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:49:21.143200 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6cbe4245-99a1-4aff-bcc9-61c67a917be7 tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "DELETE /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 404 len: 111 microversion: 2.20 time: 0.032915 Jun 22 18:49:21.143200 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 604/1158] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jun 22 18:49:21 2022] DELETE /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 18:49:21.149680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-99946ec8-c937-4939-9b6e-4f4560521f2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:21.150352 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-99946ec8-c937-4939-9b6e-4f4560521f2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] [instance: 688c6da6-d454-4dc0-8335-b0a4e16f5824] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:21.157657 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-99946ec8-c937-4939-9b6e-4f4560521f2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:21.158115 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-99946ec8-c937-4939-9b6e-4f4560521f2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:21.158888 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-99946ec8-c937-4939-9b6e-4f4560521f2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:21.159327 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-99946ec8-c937-4939-9b6e-4f4560521f2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:21.172894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-99946ec8-c937-4939-9b6e-4f4560521f2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] HTTP exception thrown: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-99946ec8-c937-4939-9b6e-4f4560521f2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Request method failure captured: Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 HTTP/1.1 Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2GMNVVijv6NFrZXVk60QuvtN4TVQ9Cc-S-SaR6g-aSlefiS2lHfhM-yCKj-50B3bn-mxIDEKPapluuF_DwUMwyg1STapeS4ocHStk3bSjCpmQCMLEX_2aMyoz4OqNKVgnIxzVKL4lIWpZg1p7BARHUWtjVuyk0CFlk3258Hj2BxQRc Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: bd1ef211ea584b0abd50b02208966d7a Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:49:21.174488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:49:21.176139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bd1ef211ea584b0abd50b02208966d7a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd1ef211ea584b0abd50b02208966d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:49:21.176139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:21.176139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: bd1ef211ea584b0abd50b02208966d7a Jun 22 18:49:21.176139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1352239561 Jun 22 18:49:21.176139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeShelveTestJSON-1352239561-project Jun 22 18:49:21.176139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:49:21.176139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:49:21.176139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 8978ed54252843f78b0d00d37b475ad2 Jun 22 18:49:21.176139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1352239561-project Jun 22 18:49:21.176139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:49:21.176139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:49:21.176139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '688c6da6-d454-4dc0-8335-b0a4e16f5824'} Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:49:21.177264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. Jun 22 18:49:21.178674 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:49:21.179956 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-99946ec8-c937-4939-9b6e-4f4560521f2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] Returning 404 to user: Instance 688c6da6-d454-4dc0-8335-b0a4e16f5824 could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:49:21.179956 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-99946ec8-c937-4939-9b6e-4f4560521f2e tempest-AttachVolumeShelveTestJSON-1352239561 tempest-AttachVolumeShelveTestJSON-1352239561-project] 10.222.0.18 "GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824" status: 404 len: 111 microversion: 2.20 time: 0.030226 Jun 22 18:49:21.179956 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 555/1159] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 22 18:49:21 2022] GET /compute/v2.1/servers/688c6da6-d454-4dc0-8335-b0a4e16f5824 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 18:49:23.847539 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-a8a5fbe8-8b50-4869-b8d0-8ab6c607953c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:23.848084 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-a8a5fbe8-8b50-4869-b8d0-8ab6c607953c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:23.850076 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:23.855589 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a8a5fbe8-8b50-4869-b8d0-8ab6c607953c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:23.856055 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a8a5fbe8-8b50-4869-b8d0-8ab6c607953c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:23.856827 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a8a5fbe8-8b50-4869-b8d0-8ab6c607953c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:23.857254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-a8a5fbe8-8b50-4869-b8d0-8ab6c607953c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:23.952900 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-a8a5fbe8-8b50-4869-b8d0-8ab6c607953c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lazy-loading 'services' on Instance uuid 4fb3b050-8559-4934-8357-efabd72c4c10 {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:49:24.041347 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-a8a5fbe8-8b50-4869-b8d0-8ab6c607953c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10/os-volume_attachments/878aa4fc-0159-46c1-a051-5240534da129" status: 202 len: 0 microversion: 2.1 time: 0.197821 Jun 22 18:49:24.042394 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 605/1160] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 18:49:23 2022] DELETE /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10/os-volume_attachments/878aa4fc-0159-46c1-a051-5240534da129 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:49:25.174435 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-cfee0aea-e560-4e88-9883-5942cbaeb88a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:25.174918 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-cfee0aea-e560-4e88-9883-5942cbaeb88a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:25.181912 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cfee0aea-e560-4e88-9883-5942cbaeb88a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:25.182358 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cfee0aea-e560-4e88-9883-5942cbaeb88a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:25.183140 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cfee0aea-e560-4e88-9883-5942cbaeb88a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:25.183572 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cfee0aea-e560-4e88-9883-5942cbaeb88a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:25.213646 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-cfee0aea-e560-4e88-9883-5942cbaeb88a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Going to try to terminate instance {{(pid=129743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:49:25.249698 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:49:25.293882 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-cfee0aea-e560-4e88-9883-5942cbaeb88a tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 204 len: 0 microversion: 2.1 time: 0.123945 Jun 22 18:49:25.296244 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 556/1161] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:49:25 2022] DELETE /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 18:49:25.305790 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-92ff16f8-5bc7-4deb-aaba-e4c08602ff6f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:25.306488 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-92ff16f8-5bc7-4deb-aaba-e4c08602ff6f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:25.313217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-92ff16f8-5bc7-4deb-aaba-e4c08602ff6f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:25.313668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-92ff16f8-5bc7-4deb-aaba-e4c08602ff6f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:25.314475 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-92ff16f8-5bc7-4deb-aaba-e4c08602ff6f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:25.315108 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-92ff16f8-5bc7-4deb-aaba-e4c08602ff6f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:25.456364 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-92ff16f8-5bc7-4deb-aaba-e4c08602ff6f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:25.463794 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-92ff16f8-5bc7-4deb-aaba-e4c08602ff6f tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1513 microversion: 2.1 time: 0.163057 Jun 22 18:49:25.464400 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 606/1162] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:25 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:49:26.482290 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-92cd8f72-9553-46bf-b67d-c4f76916de3b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:26.482978 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-92cd8f72-9553-46bf-b67d-c4f76916de3b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:26.490574 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-92cd8f72-9553-46bf-b67d-c4f76916de3b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:26.491149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-92cd8f72-9553-46bf-b67d-c4f76916de3b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:26.492093 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-92cd8f72-9553-46bf-b67d-c4f76916de3b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:26.492444 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-92cd8f72-9553-46bf-b67d-c4f76916de3b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:26.647343 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-92cd8f72-9553-46bf-b67d-c4f76916de3b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:26.655446 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-92cd8f72-9553-46bf-b67d-c4f76916de3b tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1513 microversion: 2.1 time: 0.177318 Jun 22 18:49:26.659891 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 557/1163] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:26 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:49:27.672484 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-cb7ee918-83cd-4a99-8fe4-b6baa885c5a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:27.673102 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-cb7ee918-83cd-4a99-8fe4-b6baa885c5a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:27.680154 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cb7ee918-83cd-4a99-8fe4-b6baa885c5a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:27.681185 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cb7ee918-83cd-4a99-8fe4-b6baa885c5a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:27.682130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cb7ee918-83cd-4a99-8fe4-b6baa885c5a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:27.682565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-cb7ee918-83cd-4a99-8fe4-b6baa885c5a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:27.828586 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-cb7ee918-83cd-4a99-8fe4-b6baa885c5a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:27.837030 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-cb7ee918-83cd-4a99-8fe4-b6baa885c5a7 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1513 microversion: 2.1 time: 0.168340 Jun 22 18:49:27.837596 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 607/1164] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:27 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:49:28.854794 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-37933479-dfd5-4136-9449-3fa0615eb5c5 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:28.856998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-37933479-dfd5-4136-9449-3fa0615eb5c5 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:28.865028 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-37933479-dfd5-4136-9449-3fa0615eb5c5 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:28.865486 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-37933479-dfd5-4136-9449-3fa0615eb5c5 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:28.866264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-37933479-dfd5-4136-9449-3fa0615eb5c5 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:28.866947 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-37933479-dfd5-4136-9449-3fa0615eb5c5 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:28.893610 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-41748116-b326-4f16-9fd5-f39098b31dde req-bace8960-40eb-4271-88ce-ed1a83068dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb3b050-8559-4934-8357-efabd72c4c10", "name": "network-vif-deleted", "tag": "2d5ddc2a-3a47-4887-ab1f-85e3ebf528d6"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:49:28.919269 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-41748116-b326-4f16-9fd5-f39098b31dde req-bace8960-40eb-4271-88ce-ed1a83068dc5 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:28.919906 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-41748116-b326-4f16-9fd5-f39098b31dde req-bace8960-40eb-4271-88ce-ed1a83068dc5 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:28.938678 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-41748116-b326-4f16-9fd5-f39098b31dde req-bace8960-40eb-4271-88ce-ed1a83068dc5 service nova] Creating event network-vif-deleted:2d5ddc2a-3a47-4887-ab1f-85e3ebf528d6 for instance 4fb3b050-8559-4934-8357-efabd72c4c10 on hv-cinder-81268 Jun 22 18:49:28.946179 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-41748116-b326-4f16-9fd5-f39098b31dde req-bace8960-40eb-4271-88ce-ed1a83068dc5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057989 Jun 22 18:49:28.947310 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 608/1165] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:49:28.967684 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-37933479-dfd5-4136-9449-3fa0615eb5c5 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b995c6bf02b4e50aa836324c6f3414e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500e8157246e450ea87f751218856c7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:49:28.977266 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-37933479-dfd5-4136-9449-3fa0615eb5c5 tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 200 len: 1471 microversion: 2.1 time: 0.126234 Jun 22 18:49:28.977854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 558/1166] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:28 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 1471 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:49:29.995147 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2f20a3ce-a7ce-4cda-810c-795974dced4c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:49:29.995947 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2f20a3ce-a7ce-4cda-810c-795974dced4c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] [instance: 4fb3b050-8559-4934-8357-efabd72c4c10] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:49:30.003386 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2f20a3ce-a7ce-4cda-810c-795974dced4c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:30.003856 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2f20a3ce-a7ce-4cda-810c-795974dced4c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:30.004730 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2f20a3ce-a7ce-4cda-810c-795974dced4c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:49:30.005277 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2f20a3ce-a7ce-4cda-810c-795974dced4c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:49:30.019630 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-2f20a3ce-a7ce-4cda-810c-795974dced4c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] HTTP exception thrown: Instance 4fb3b050-8559-4934-8357-efabd72c4c10 could not be found. Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2f20a3ce-a7ce-4cda-810c-795974dced4c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Request method failure captured: Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 HTTP/1.1 Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2OZjSyAsoL33umvN0BEiUikyzKANjP7Ns3iNbgsCsVxpWUQNJpHNdApoPdNbw_zVBz6PezeHJrFz8FEbgwxuAkVIwfmwUjlUKSoU9uqtX9hGo-ixMeEgNxft7CnsnU0ZU06GHJhK_UYlBxhy53LNSZKVLbpLI6KjfquNdIraC10DPI Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 500e8157246e450ea87f751218856c7a Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-VolumesSnapshotTestJSON-830075092 Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:49:30.021276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:49:30.022943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_500e8157246e450ea87f751218856c7a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/500e8157246e450ea87f751218856c7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/500e8157246e450ea87f751218856c7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/500e8157246e450ea87f751218856c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:49:30.022943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-VolumesSnapshotTestJSON-830075092 Jun 22 18:49:30.022943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 500e8157246e450ea87f751218856c7a Jun 22 18:49:30.022943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-830075092 Jun 22 18:49:30.022943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-VolumesSnapshotTestJSON-830075092-project Jun 22 18:49:30.022943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:49:30.022943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:49:30.022943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 5b995c6bf02b4e50aa836324c6f3414e Jun 22 18:49:30.022943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-VolumesSnapshotTestJSON-830075092-project Jun 22 18:49:30.022943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:49:30.022943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance 4fb3b050-8559-4934-8357-efabd72c4c10 could not be found. Jun 22 18:49:30.022943 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '4fb3b050-8559-4934-8357-efabd72c4c10'} Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb3b050-8559-4934-8357-efabd72c4c10 could not be found. Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:49:30.023888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb3b050-8559-4934-8357-efabd72c4c10 could not be found. Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb3b050-8559-4934-8357-efabd72c4c10 could not be found. Jun 22 18:49:30.025388 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:49:30.026773 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2f20a3ce-a7ce-4cda-810c-795974dced4c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] Returning 404 to user: Instance 4fb3b050-8559-4934-8357-efabd72c4c10 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:49:30.026773 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2f20a3ce-a7ce-4cda-810c-795974dced4c tempest-VolumesSnapshotTestJSON-830075092 tempest-VolumesSnapshotTestJSON-830075092-project] 10.222.0.18 "GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10" status: 404 len: 111 microversion: 2.1 time: 0.032395 Jun 22 18:49:30.026773 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 609/1167] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:49:29 2022] GET /compute/v2.1/servers/4fb3b050-8559-4934-8357-efabd72c4c10 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:50:10.633095 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-88cfc5f4-0819-4f38-83cc-bfcde5c2ee5b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:50:10.634372 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-88cfc5f4-0819-4f38-83cc-bfcde5c2ee5b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:50:10.639379 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-807bce85-0e39-4167-a89f-d23c78d5b5dd req-ef1dd9c0-2361-4c9d-8f3a-67e87f70aacb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb", "tag": "1f2bbc0f-6456-4502-a10e-356c766c7742"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:50:10.641156 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:10.641969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:10.643676 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-88cfc5f4-0819-4f38-83cc-bfcde5c2ee5b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:10.644210 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-88cfc5f4-0819-4f38-83cc-bfcde5c2ee5b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:10.646231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-88cfc5f4-0819-4f38-83cc-bfcde5c2ee5b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:10.647319 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-88cfc5f4-0819-4f38-83cc-bfcde5c2ee5b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:10.650014 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=9 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:10.651091 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:10.653596 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-807bce85-0e39-4167-a89f-d23c78d5b5dd req-ef1dd9c0-2361-4c9d-8f3a-67e87f70aacb service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:10.654318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-807bce85-0e39-4167-a89f-d23c78d5b5dd req-ef1dd9c0-2361-4c9d-8f3a-67e87f70aacb service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:10.679697 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-88cfc5f4-0819-4f38-83cc-bfcde5c2ee5b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Going to try to terminate instance {{(pid=129743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:50:10.681266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-807bce85-0e39-4167-a89f-d23c78d5b5dd req-ef1dd9c0-2361-4c9d-8f3a-67e87f70aacb service nova] Creating event network-changed:1f2bbc0f-6456-4502-a10e-356c766c7742 for instance c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb on hv-cinder-81268 Jun 22 18:50:10.689733 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-807bce85-0e39-4167-a89f-d23c78d5b5dd req-ef1dd9c0-2361-4c9d-8f3a-67e87f70aacb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057095 Jun 22 18:50:10.690676 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 610/1168] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:50:10.814501 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-88cfc5f4-0819-4f38-83cc-bfcde5c2ee5b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 204 len: 0 microversion: 2.1 time: 0.183919 Jun 22 18:50:10.826812 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-aa027f59-52f8-44b3-94f6-956ab61dd12d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:50:10.827612 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-aa027f59-52f8-44b3-94f6-956ab61dd12d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:50:10.830782 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 559/1169] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:50:10 2022] DELETE /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 18:50:10.835634 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-aa027f59-52f8-44b3-94f6-956ab61dd12d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:10.836119 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-aa027f59-52f8-44b3-94f6-956ab61dd12d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:10.837190 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-aa027f59-52f8-44b3-94f6-956ab61dd12d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:10.837681 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-aa027f59-52f8-44b3-94f6-956ab61dd12d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:10.996916 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-aa027f59-52f8-44b3-94f6-956ab61dd12d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:50:11.005903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-aa027f59-52f8-44b3-94f6-956ab61dd12d tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1578 microversion: 2.1 time: 0.185449 Jun 22 18:50:11.007759 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 611/1170] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:50:10 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:50:12.032125 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4635571e-e56a-4168-93f5-92652d1618a3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:50:12.033571 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-4635571e-e56a-4168-93f5-92652d1618a3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:50:12.041201 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4635571e-e56a-4168-93f5-92652d1618a3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:12.041708 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4635571e-e56a-4168-93f5-92652d1618a3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:12.042695 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4635571e-e56a-4168-93f5-92652d1618a3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:12.043122 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4635571e-e56a-4168-93f5-92652d1618a3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:12.398306 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4635571e-e56a-4168-93f5-92652d1618a3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:50:12.408526 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4635571e-e56a-4168-93f5-92652d1618a3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1578 microversion: 2.1 time: 0.382862 Jun 22 18:50:12.418091 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 560/1171] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:50:12 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1578 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:50:13.426454 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d39c111d-2868-4011-a1b6-434cf56accf3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:50:13.427713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d39c111d-2868-4011-a1b6-434cf56accf3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:50:13.434177 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d39c111d-2868-4011-a1b6-434cf56accf3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:13.435000 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d39c111d-2868-4011-a1b6-434cf56accf3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:13.436067 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d39c111d-2868-4011-a1b6-434cf56accf3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:13.436733 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d39c111d-2868-4011-a1b6-434cf56accf3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:14.049350 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d39c111d-2868-4011-a1b6-434cf56accf3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:50:14.067304 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d39c111d-2868-4011-a1b6-434cf56accf3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 200 len: 1459 microversion: 2.1 time: 0.645297 Jun 22 18:50:14.069000 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 612/1172] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:50:13 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 1459 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:50:14.226794 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-55f86709-88e5-48b0-a1f6-cd56d28e66c2 req-1c946923-1123-4bbf-a137-a54fb6a85b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb", "name": "network-vif-deleted", "tag": "1f2bbc0f-6456-4502-a10e-356c766c7742"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:50:14.246150 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-55f86709-88e5-48b0-a1f6-cd56d28e66c2 req-1c946923-1123-4bbf-a137-a54fb6a85b9e service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:14.246630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-55f86709-88e5-48b0-a1f6-cd56d28e66c2 req-1c946923-1123-4bbf-a137-a54fb6a85b9e service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:14.263508 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-55f86709-88e5-48b0-a1f6-cd56d28e66c2 req-1c946923-1123-4bbf-a137-a54fb6a85b9e service nova] Creating event network-vif-deleted:1f2bbc0f-6456-4502-a10e-356c766c7742 for instance c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb on hv-cinder-81268 Jun 22 18:50:14.269827 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-55f86709-88e5-48b0-a1f6-cd56d28e66c2 req-1c946923-1123-4bbf-a137-a54fb6a85b9e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047294 Jun 22 18:50:14.270696 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 561/1173] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:50:15.085005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-41e3130a-0776-44a0-9b9e-fad929191519 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:50:15.086213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-41e3130a-0776-44a0-9b9e-fad929191519 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:50:15.094356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-41e3130a-0776-44a0-9b9e-fad929191519 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:15.095138 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-41e3130a-0776-44a0-9b9e-fad929191519 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:15.096120 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-41e3130a-0776-44a0-9b9e-fad929191519 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:15.096773 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-41e3130a-0776-44a0-9b9e-fad929191519 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:15.114431 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-41e3130a-0776-44a0-9b9e-fad929191519 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] HTTP exception thrown: Instance c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb could not be found. Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-41e3130a-0776-44a0-9b9e-fad929191519 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Request method failure captured: Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb HTTP/1.1 Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2IZ5TEn4BPJxHVhfhnxT81mrnbs2Rk9PmROtVEhJaPF5p-1m3EjFvkYS_fxfJuQdyZ4nj9IGq-NZb-_R5hx2v_cf0weelJidA7CIwKSfDi3xGV3LmeUhFpr87uFtSapDeG2jvPF3QjFh3W32Ju3irT1oTg4iPue-PHvhHF7gx7Sz5o Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 49c7f224d0374125ae22f576e8757f29 Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:50:15.116466 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:50:15.118284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_49c7f224d0374125ae22f576e8757f29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:50:15.118284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:50:15.118284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 49c7f224d0374125ae22f576e8757f29 Jun 22 18:50:15.118284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:50:15.118284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-TestVolumeBootPattern-1174551677-project Jun 22 18:50:15.118284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:50:15.118284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:50:15.118284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 00cfbc965d934d6db28f41f8082eb5ef Jun 22 18:50:15.118284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-TestVolumeBootPattern-1174551677-project Jun 22 18:50:15.118284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:50:15.118284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb could not be found. Jun 22 18:50:15.118284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': 'c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb'} Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb could not be found. Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:50:15.119274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb could not be found. Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb could not be found. Jun 22 18:50:15.120832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:50:15.123083 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-41e3130a-0776-44a0-9b9e-fad929191519 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Returning 404 to user: Instance c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:50:15.124319 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-41e3130a-0776-44a0-9b9e-fad929191519 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb" status: 404 len: 111 microversion: 2.1 time: 0.043178 Jun 22 18:50:15.125724 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 613/1174] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:50:15 2022] GET /compute/v2.1/servers/c54e0613-2d8f-4ba1-af6b-ed0d35c4eedb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:50:19.635971 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-02a58a32-ea39-44e0-bf3b-7151bed3dbb6 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:50:19.636555 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-02a58a32-ea39-44e0-bf3b-7151bed3dbb6 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:50:19.648039 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-d0bc7f7f-5c2e-422a-8c4f-ee13b85b8a03 req-371c2bf1-56c7-4471-bdc0-8495ee387db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37c799c-85a7-4ac9-ae8d-bd750ce354c8", "tag": "5a6f9e4b-2519-489b-b184-812b2e830a17"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:50:19.657773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-02a58a32-ea39-44e0-bf3b-7151bed3dbb6 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:19.658605 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-02a58a32-ea39-44e0-bf3b-7151bed3dbb6 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:19.660709 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-02a58a32-ea39-44e0-bf3b-7151bed3dbb6 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:19.663156 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-d0bc7f7f-5c2e-422a-8c4f-ee13b85b8a03 req-371c2bf1-56c7-4471-bdc0-8495ee387db4 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:19.663645 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-02a58a32-ea39-44e0-bf3b-7151bed3dbb6 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:19.665458 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-d0bc7f7f-5c2e-422a-8c4f-ee13b85b8a03 req-371c2bf1-56c7-4471-bdc0-8495ee387db4 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:19.700878 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-d0bc7f7f-5c2e-422a-8c4f-ee13b85b8a03 req-371c2bf1-56c7-4471-bdc0-8495ee387db4 service nova] Creating event network-changed:5a6f9e4b-2519-489b-b184-812b2e830a17 for instance f37c799c-85a7-4ac9-ae8d-bd750ce354c8 on hv-cinder-81268 Jun 22 18:50:19.709935 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-d0bc7f7f-5c2e-422a-8c4f-ee13b85b8a03 req-371c2bf1-56c7-4471-bdc0-8495ee387db4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069035 Jun 22 18:50:19.710543 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 614/1175] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:50:19.751542 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-02a58a32-ea39-44e0-bf3b-7151bed3dbb6 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Going to try to terminate instance {{(pid=129743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:50:19.940785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-02a58a32-ea39-44e0-bf3b-7151bed3dbb6 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 204 len: 0 microversion: 2.1 time: 0.307780 Jun 22 18:50:19.945418 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 562/1176] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:50:19 2022] DELETE /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:50:19.954496 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-898be282-0f52-43c6-8d7b-c2c5e936f4ce tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:50:19.955905 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-898be282-0f52-43c6-8d7b-c2c5e936f4ce tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:50:19.969198 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-898be282-0f52-43c6-8d7b-c2c5e936f4ce tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:19.970881 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-898be282-0f52-43c6-8d7b-c2c5e936f4ce tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:19.977796 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-898be282-0f52-43c6-8d7b-c2c5e936f4ce tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:19.978705 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-898be282-0f52-43c6-8d7b-c2c5e936f4ce tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:20.223017 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-898be282-0f52-43c6-8d7b-c2c5e936f4ce tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:50:20.230556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-898be282-0f52-43c6-8d7b-c2c5e936f4ce tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1578 microversion: 2.1 time: 0.283844 Jun 22 18:50:20.240245 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 615/1177] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:50:19 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1578 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:50:21.269639 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-4f50a509-4f50-4dcf-a43e-7cfcec0a9d2b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:50:21.270818 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-4f50a509-4f50-4dcf-a43e-7cfcec0a9d2b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:50:21.288983 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4f50a509-4f50-4dcf-a43e-7cfcec0a9d2b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:21.289893 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4f50a509-4f50-4dcf-a43e-7cfcec0a9d2b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:21.291064 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4f50a509-4f50-4dcf-a43e-7cfcec0a9d2b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:21.299041 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-4f50a509-4f50-4dcf-a43e-7cfcec0a9d2b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:21.617643 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-4f50a509-4f50-4dcf-a43e-7cfcec0a9d2b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cfbc965d934d6db28f41f8082eb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c7f224d0374125ae22f576e8757f29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:50:21.635085 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-4f50a509-4f50-4dcf-a43e-7cfcec0a9d2b tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 200 len: 1459 microversion: 2.1 time: 0.367747 Jun 22 18:50:21.635784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 563/1178] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:50:21 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 1459 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:50:21.835026 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-dd3dc68a-3536-4824-a3fd-4919e3b983d3 req-83e33b8f-4682-4c76-a63f-6d974445a66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37c799c-85a7-4ac9-ae8d-bd750ce354c8", "name": "network-vif-deleted", "tag": "5a6f9e4b-2519-489b-b184-812b2e830a17"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:50:21.849811 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-dd3dc68a-3536-4824-a3fd-4919e3b983d3 req-83e33b8f-4682-4c76-a63f-6d974445a66d service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:21.850244 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-dd3dc68a-3536-4824-a3fd-4919e3b983d3 req-83e33b8f-4682-4c76-a63f-6d974445a66d service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:21.866517 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-dd3dc68a-3536-4824-a3fd-4919e3b983d3 req-83e33b8f-4682-4c76-a63f-6d974445a66d service nova] Creating event network-vif-deleted:5a6f9e4b-2519-489b-b184-812b2e830a17 for instance f37c799c-85a7-4ac9-ae8d-bd750ce354c8 on hv-cinder-81268 Jun 22 18:50:21.873565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-dd3dc68a-3536-4824-a3fd-4919e3b983d3 req-83e33b8f-4682-4c76-a63f-6d974445a66d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042335 Jun 22 18:50:21.874555 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 616/1179] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:50:22.655624 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3ff25fc7-b1a0-4840-91c3-c0684df833f3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:50:22.658609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3ff25fc7-b1a0-4840-91c3-c0684df833f3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: f37c799c-85a7-4ac9-ae8d-bd750ce354c8] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:50:22.666703 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3ff25fc7-b1a0-4840-91c3-c0684df833f3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:22.667448 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3ff25fc7-b1a0-4840-91c3-c0684df833f3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:22.668514 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3ff25fc7-b1a0-4840-91c3-c0684df833f3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:22.669567 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3ff25fc7-b1a0-4840-91c3-c0684df833f3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:22.687234 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-3ff25fc7-b1a0-4840-91c3-c0684df833f3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] HTTP exception thrown: Instance f37c799c-85a7-4ac9-ae8d-bd750ce354c8 could not be found. Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3ff25fc7-b1a0-4840-91c3-c0684df833f3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Request method failure captured: Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 HTTP/1.1 Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2IZ5TEn4BPJxHVhfhnxT81mrnbs2Rk9PmROtVEhJaPF5p-1m3EjFvkYS_fxfJuQdyZ4nj9IGq-NZb-_R5hx2v_cf0weelJidA7CIwKSfDi3xGV3LmeUhFpr87uFtSapDeG2jvPF3QjFh3W32Ju3irT1oTg4iPue-PHvhHF7gx7Sz5o Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 49c7f224d0374125ae22f576e8757f29 Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:50:22.695613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:50:22.697170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_49c7f224d0374125ae22f576e8757f29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:50:22.697170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:50:22.697170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 49c7f224d0374125ae22f576e8757f29 Jun 22 18:50:22.697170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:50:22.697170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-TestVolumeBootPattern-1174551677-project Jun 22 18:50:22.697170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:50:22.697170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:50:22.697170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 00cfbc965d934d6db28f41f8082eb5ef Jun 22 18:50:22.697170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-TestVolumeBootPattern-1174551677-project Jun 22 18:50:22.697170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:50:22.697170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance f37c799c-85a7-4ac9-ae8d-bd750ce354c8 could not be found. Jun 22 18:50:22.697170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': 'f37c799c-85a7-4ac9-ae8d-bd750ce354c8'} Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37c799c-85a7-4ac9-ae8d-bd750ce354c8 could not be found. Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:50:22.697938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37c799c-85a7-4ac9-ae8d-bd750ce354c8 could not be found. Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37c799c-85a7-4ac9-ae8d-bd750ce354c8 could not be found. Jun 22 18:50:22.699175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:50:22.700438 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3ff25fc7-b1a0-4840-91c3-c0684df833f3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Returning 404 to user: Instance f37c799c-85a7-4ac9-ae8d-bd750ce354c8 could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:50:22.700438 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3ff25fc7-b1a0-4840-91c3-c0684df833f3 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8" status: 404 len: 111 microversion: 2.1 time: 0.047260 Jun 22 18:50:22.700438 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 564/1180] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:50:22 2022] GET /compute/v2.1/servers/f37c799c-85a7-4ac9-ae8d-bd750ce354c8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:50:23.246653 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-54b1b073-a848-4ac7-ae82-b7e2417e122a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:50:23.247407 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-54b1b073-a848-4ac7-ae82-b7e2417e122a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:50:23.258327 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-54b1b073-a848-4ac7-ae82-b7e2417e122a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:23.258992 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-54b1b073-a848-4ac7-ae82-b7e2417e122a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:23.259875 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-54b1b073-a848-4ac7-ae82-b7e2417e122a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:23.260339 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-54b1b073-a848-4ac7-ae82-b7e2417e122a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:23.283949 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-54b1b073-a848-4ac7-ae82-b7e2417e122a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] HTTP exception thrown: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-54b1b073-a848-4ac7-ae82-b7e2417e122a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Request method failure captured: Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: DELETE /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 HTTP/1.1 Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2IZ5TEn4BPJxHVhfhnxT81mrnbs2Rk9PmROtVEhJaPF5p-1m3EjFvkYS_fxfJuQdyZ4nj9IGq-NZb-_R5hx2v_cf0weelJidA7CIwKSfDi3xGV3LmeUhFpr87uFtSapDeG2jvPF3QjFh3W32Ju3irT1oTg4iPue-PHvhHF7gx7Sz5o Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 49c7f224d0374125ae22f576e8757f29 Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:50:23.286775 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:50:23.288220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_49c7f224d0374125ae22f576e8757f29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:50:23.288220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:50:23.288220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 49c7f224d0374125ae22f576e8757f29 Jun 22 18:50:23.288220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:50:23.288220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-TestVolumeBootPattern-1174551677-project Jun 22 18:50:23.288220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:50:23.288220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:50:23.288220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 00cfbc965d934d6db28f41f8082eb5ef Jun 22 18:50:23.288220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-TestVolumeBootPattern-1174551677-project Jun 22 18:50:23.288220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:50:23.288220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:50:23.288220 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': 'e2394525-6da9-4670-a17a-392e0c892204'} Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:50:23.289130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:50:23.292702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:50:23.295403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-54b1b073-a848-4ac7-ae82-b7e2417e122a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Returning 404 to user: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:50:23.295403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-54b1b073-a848-4ac7-ae82-b7e2417e122a tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 404 len: 111 microversion: 2.1 time: 0.051006 Jun 22 18:50:23.295403 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 617/1181] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:50:23 2022] DELETE /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:50:23.301904 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e527ddbe-6fc1-4ff0-9232-0c89f60ef7d9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:50:23.302531 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e527ddbe-6fc1-4ff0-9232-0c89f60ef7d9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] [instance: e2394525-6da9-4670-a17a-392e0c892204] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:50:23.309173 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e527ddbe-6fc1-4ff0-9232-0c89f60ef7d9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:23.309771 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e527ddbe-6fc1-4ff0-9232-0c89f60ef7d9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:23.310621 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e527ddbe-6fc1-4ff0-9232-0c89f60ef7d9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:23.311063 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e527ddbe-6fc1-4ff0-9232-0c89f60ef7d9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:23.326579 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-e527ddbe-6fc1-4ff0-9232-0c89f60ef7d9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] HTTP exception thrown: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e527ddbe-6fc1-4ff0-9232-0c89f60ef7d9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Request method failure captured: Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 HTTP/1.1 Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2IZ5TEn4BPJxHVhfhnxT81mrnbs2Rk9PmROtVEhJaPF5p-1m3EjFvkYS_fxfJuQdyZ4nj9IGq-NZb-_R5hx2v_cf0weelJidA7CIwKSfDi3xGV3LmeUhFpr87uFtSapDeG2jvPF3QjFh3W32Ju3irT1oTg4iPue-PHvhHF7gx7Sz5o Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 49c7f224d0374125ae22f576e8757f29 Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:50:23.329229 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:50:23.330822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_49c7f224d0374125ae22f576e8757f29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/49c7f224d0374125ae22f576e8757f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:50:23.330822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:50:23.330822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 49c7f224d0374125ae22f576e8757f29 Jun 22 18:50:23.330822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-TestVolumeBootPattern-1174551677 Jun 22 18:50:23.330822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-TestVolumeBootPattern-1174551677-project Jun 22 18:50:23.330822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:50:23.330822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:50:23.330822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 00cfbc965d934d6db28f41f8082eb5ef Jun 22 18:50:23.330822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-TestVolumeBootPattern-1174551677-project Jun 22 18:50:23.330822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:50:23.330822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:50:23.330822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': 'e2394525-6da9-4670-a17a-392e0c892204'} Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:50:23.331609 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. Jun 22 18:50:23.334468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:50:23.336916 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e527ddbe-6fc1-4ff0-9232-0c89f60ef7d9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Returning 404 to user: Instance e2394525-6da9-4670-a17a-392e0c892204 could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:50:23.336916 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e527ddbe-6fc1-4ff0-9232-0c89f60ef7d9 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204" status: 404 len: 111 microversion: 2.1 time: 0.033513 Jun 22 18:50:23.336916 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 565/1182] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:50:23 2022] GET /compute/v2.1/servers/e2394525-6da9-4670-a17a-392e0c892204 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:50:24.215166 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-94c67c5f-fd7c-4e25-969d-cb0d6644b62e tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Action: 'create', calling method: .version_select at 0x7fd75548b310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1907804867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvf1XKhA3Rrz8rdTOMaGeYI6Hh/uGDdaS6vjU1F5AkgVPaQ/Jp+YdDEi7mACCHs50zSYnPs9So/J5Cny37HSTxpgnijwLyXonyrxX0aTTkYF5579cp76+rdspG6EtvVlg=="}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:50:24.229898 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-94c67c5f-fd7c-4e25-969d-cb0d6644b62e tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Getting quotas for project 5ccf6560673c40cb9f4acb20d10400c6. Resources: {'key_pairs'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:50:24.234088 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-94c67c5f-fd7c-4e25-969d-cb0d6644b62e tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Getting quotas for user 16029fcf926c49f9b8cf10f41db61436 and project 5ccf6560673c40cb9f4acb20d10400c6. Resources: {'key_pairs'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:50:24.258724 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-94c67c5f-fd7c-4e25-969d-cb0d6644b62e tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.298502 Jun 22 18:50:24.259727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 618/1183] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 18:50:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:50:24.716074 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6fa6a58d-9a94-4d0e-a1a1-5e6ae8d74ae8 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] Calling method '.version_select at 0x7fd75566af70>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:50:24.760656 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6fa6a58d-9a94-4d0e-a1a1-5e6ae8d74ae8 tempest-TestVolumeBootPattern-1174551677 tempest-TestVolumeBootPattern-1174551677-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2107367893" status: 202 len: 0 microversion: 2.1 time: 0.050053 Jun 22 18:50:24.762253 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 566/1184] 10.222.0.18 () {58 vars in 1262 bytes} [Wed Jun 22 18:50:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2107367893 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:50:59.038534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=28 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:59.039394 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=4 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:59.040171 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:59.044347 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-413302522", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1907804867", "security_groups": [{"name": "tempest-secgroup-smoke-26423465"}], "networks": [{"uuid": "9f679ae3-d961-4b59-8294-54ac9c2c34e6"}], "block_device_mapping_v2": [{"uuid": "23a15303-9bfd-4a7e-b2e9-1458b7939429", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:50:59.162332 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.network.neutron [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] validate_networks() for [('9f679ae3-d961-4b59-8294-54ac9c2c34e6', None, None, None, None, None)] {{(pid=129744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:50:59.633550 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Flavor limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:50:59.634104 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Image limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:50:59.634606 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Flavor pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:50:59.635015 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Image pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:50:59.635422 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:50:59.644540 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:59.645050 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:59.645935 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:50:59.646372 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:50:59.664038 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Getting quotas for project 5ccf6560673c40cb9f4acb20d10400c6. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:50:59.668156 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Getting quotas for user 16029fcf926c49f9b8cf10f41db61436 and project 5ccf6560673c40cb9f4acb20d10400c6. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:50:59.729412 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Going to run 1 instances... {{(pid=129744) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:50:59.731483 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='23a15303-9bfd-4a7e-b2e9-1458b7939429',volume_size=None,volume_type=None)] {{(pid=129744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:50:59.863390 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-33b64408-69fb-4f93-bd0e-59e9d833aa67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.825969 Jun 22 18:50:59.864133 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 619/1185] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:50:59 2022] POST /compute/v2.1/servers => generated 404 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:50:59.872388 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:59.873176 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:50:59.877101 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d1745e1f-8153-427b-b6fb-6e86c7fb5ce4 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:50:59.877993 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d1745e1f-8153-427b-b6fb-6e86c7fb5ce4 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:50:59.942146 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d1745e1f-8153-427b-b6fb-6e86c7fb5ce4 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:50:59.949204 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d1745e1f-8153-427b-b6fb-6e86c7fb5ce4 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1088 microversion: 2.1 time: 0.078385 Jun 22 18:50:59.949772 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 567/1186] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:50:59 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:00.966833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-596c8df6-aff9-4e92-b1cf-076d0e74c93b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:00.969134 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-596c8df6-aff9-4e92-b1cf-076d0e74c93b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:00.978558 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-596c8df6-aff9-4e92-b1cf-076d0e74c93b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:00.979040 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-596c8df6-aff9-4e92-b1cf-076d0e74c93b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:00.979819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-596c8df6-aff9-4e92-b1cf-076d0e74c93b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:00.980277 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-596c8df6-aff9-4e92-b1cf-076d0e74c93b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:01.053938 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-596c8df6-aff9-4e92-b1cf-076d0e74c93b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:01.063910 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-596c8df6-aff9-4e92-b1cf-076d0e74c93b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1204 microversion: 2.1 time: 0.101157 Jun 22 18:51:01.064628 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 620/1187] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:00 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1204 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:02.081867 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-9320d555-5073-4ca6-a5a8-3df40cdd9d62 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:02.082588 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-9320d555-5073-4ca6-a5a8-3df40cdd9d62 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:02.088954 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9320d555-5073-4ca6-a5a8-3df40cdd9d62 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:02.089398 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9320d555-5073-4ca6-a5a8-3df40cdd9d62 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:02.090216 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9320d555-5073-4ca6-a5a8-3df40cdd9d62 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:02.090647 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-9320d555-5073-4ca6-a5a8-3df40cdd9d62 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:02.340182 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-9320d555-5073-4ca6-a5a8-3df40cdd9d62 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:02.349358 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-9320d555-5073-4ca6-a5a8-3df40cdd9d62 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.271294 Jun 22 18:51:02.349977 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 568/1188] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:02 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:02.509185 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-c68bf5a2-a056-4429-a4af-c4371cf6e826 req-afdff326-dd1e-45a3-b9df-770a3c155121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b1480f2-347e-427e-973a-273c41839863", "tag": "826cbcec-8cca-4af8-aaf9-db06515201a3"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:51:02.518618 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-c68bf5a2-a056-4429-a4af-c4371cf6e826 req-afdff326-dd1e-45a3-b9df-770a3c155121 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:02.519049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-c68bf5a2-a056-4429-a4af-c4371cf6e826 req-afdff326-dd1e-45a3-b9df-770a3c155121 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:02.532091 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-c68bf5a2-a056-4429-a4af-c4371cf6e826 req-afdff326-dd1e-45a3-b9df-770a3c155121 service nova] Creating event network-changed:826cbcec-8cca-4af8-aaf9-db06515201a3 for instance 7b1480f2-347e-427e-973a-273c41839863 on hv-cinder-81268 Jun 22 18:51:02.538234 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-c68bf5a2-a056-4429-a4af-c4371cf6e826 req-afdff326-dd1e-45a3-b9df-770a3c155121 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033483 Jun 22 18:51:02.538859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 621/1189] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:03.366793 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-38e2279e-289f-4657-afe0-328094b12d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:03.367393 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-38e2279e-289f-4657-afe0-328094b12d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:03.373809 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-38e2279e-289f-4657-afe0-328094b12d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:03.374246 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-38e2279e-289f-4657-afe0-328094b12d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:03.374993 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-38e2279e-289f-4657-afe0-328094b12d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:03.375424 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-38e2279e-289f-4657-afe0-328094b12d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:03.508077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-38e2279e-289f-4657-afe0-328094b12d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:03.515703 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-38e2279e-289f-4657-afe0-328094b12d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.153327 Jun 22 18:51:03.516231 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 569/1190] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:03 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:04.532747 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9b9708d7-e848-447f-ba26-860cb7bba20c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:04.533443 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9b9708d7-e848-447f-ba26-860cb7bba20c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:04.540251 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9b9708d7-e848-447f-ba26-860cb7bba20c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:04.540666 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9b9708d7-e848-447f-ba26-860cb7bba20c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:04.541435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9b9708d7-e848-447f-ba26-860cb7bba20c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:04.541874 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9b9708d7-e848-447f-ba26-860cb7bba20c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:04.672822 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9b9708d7-e848-447f-ba26-860cb7bba20c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:04.681095 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9b9708d7-e848-447f-ba26-860cb7bba20c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.152618 Jun 22 18:51:04.681654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 622/1191] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:04 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:05.697884 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-199a0120-8463-4a54-97ed-c4ad445f803e tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:05.698559 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-199a0120-8463-4a54-97ed-c4ad445f803e tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:05.704715 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-199a0120-8463-4a54-97ed-c4ad445f803e tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:05.705168 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-199a0120-8463-4a54-97ed-c4ad445f803e tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:05.705926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-199a0120-8463-4a54-97ed-c4ad445f803e tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:05.706360 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-199a0120-8463-4a54-97ed-c4ad445f803e tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:05.962859 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-199a0120-8463-4a54-97ed-c4ad445f803e tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:05.970425 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-199a0120-8463-4a54-97ed-c4ad445f803e tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.276310 Jun 22 18:51:05.970989 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 570/1192] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:05 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:06.988423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-af445169-0257-430f-9ac0-25b2d5ca32cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:06.989534 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-af445169-0257-430f-9ac0-25b2d5ca32cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:06.995861 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-af445169-0257-430f-9ac0-25b2d5ca32cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:06.996320 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-af445169-0257-430f-9ac0-25b2d5ca32cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:06.997101 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-af445169-0257-430f-9ac0-25b2d5ca32cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:06.997563 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-af445169-0257-430f-9ac0-25b2d5ca32cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:07.132191 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-af445169-0257-430f-9ac0-25b2d5ca32cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:07.141325 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-af445169-0257-430f-9ac0-25b2d5ca32cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.157325 Jun 22 18:51:07.142001 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 623/1193] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:06 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:08.162805 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-421ed4a2-923d-4c08-ba44-49d5b62f2e07 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:08.163547 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-421ed4a2-923d-4c08-ba44-49d5b62f2e07 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:08.172265 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-421ed4a2-923d-4c08-ba44-49d5b62f2e07 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:08.172716 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-421ed4a2-923d-4c08-ba44-49d5b62f2e07 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:08.173485 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-421ed4a2-923d-4c08-ba44-49d5b62f2e07 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:08.173919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-421ed4a2-923d-4c08-ba44-49d5b62f2e07 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:08.316353 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-421ed4a2-923d-4c08-ba44-49d5b62f2e07 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:08.323932 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-421ed4a2-923d-4c08-ba44-49d5b62f2e07 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.165529 Jun 22 18:51:08.324582 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 571/1194] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:08 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:09.342328 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8951fff6-3539-4e95-bbcd-e827c51619d8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:09.342929 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8951fff6-3539-4e95-bbcd-e827c51619d8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:09.349500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8951fff6-3539-4e95-bbcd-e827c51619d8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:09.349939 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8951fff6-3539-4e95-bbcd-e827c51619d8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:09.350697 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8951fff6-3539-4e95-bbcd-e827c51619d8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:09.351126 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8951fff6-3539-4e95-bbcd-e827c51619d8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:09.493323 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-8951fff6-3539-4e95-bbcd-e827c51619d8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:09.500825 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8951fff6-3539-4e95-bbcd-e827c51619d8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.162286 Jun 22 18:51:09.501383 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 624/1195] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:09 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:10.518488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7752acce-cca1-4f35-83d1-a59cbf84a2f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:10.519101 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7752acce-cca1-4f35-83d1-a59cbf84a2f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:10.522199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:10.527647 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7752acce-cca1-4f35-83d1-a59cbf84a2f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:10.528129 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7752acce-cca1-4f35-83d1-a59cbf84a2f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:10.528906 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7752acce-cca1-4f35-83d1-a59cbf84a2f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:10.529343 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7752acce-cca1-4f35-83d1-a59cbf84a2f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:10.671533 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7752acce-cca1-4f35-83d1-a59cbf84a2f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:10.679785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7752acce-cca1-4f35-83d1-a59cbf84a2f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.165191 Jun 22 18:51:10.680463 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 572/1196] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:10 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:11.697268 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9c682c36-6688-4736-b0fc-5b837f1afb73 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:11.697976 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9c682c36-6688-4736-b0fc-5b837f1afb73 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:11.699991 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:11.700654 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=6 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:11.706912 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9c682c36-6688-4736-b0fc-5b837f1afb73 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:11.707360 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9c682c36-6688-4736-b0fc-5b837f1afb73 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:11.708157 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9c682c36-6688-4736-b0fc-5b837f1afb73 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:11.708693 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9c682c36-6688-4736-b0fc-5b837f1afb73 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:11.848585 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9c682c36-6688-4736-b0fc-5b837f1afb73 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:11.856132 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9c682c36-6688-4736-b0fc-5b837f1afb73 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.163751 Jun 22 18:51:11.856688 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 625/1197] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:11 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:12.873077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5ed347af-e388-4ad8-9010-8f144889f0e3 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:12.873702 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5ed347af-e388-4ad8-9010-8f144889f0e3 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:12.880536 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5ed347af-e388-4ad8-9010-8f144889f0e3 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:12.880976 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5ed347af-e388-4ad8-9010-8f144889f0e3 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:12.882378 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5ed347af-e388-4ad8-9010-8f144889f0e3 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:12.882957 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5ed347af-e388-4ad8-9010-8f144889f0e3 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:13.010640 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5ed347af-e388-4ad8-9010-8f144889f0e3 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:13.018106 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5ed347af-e388-4ad8-9010-8f144889f0e3 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.148863 Jun 22 18:51:13.018820 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 573/1198] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:12 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:14.035730 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b20eb090-8bc9-4da0-a092-1469e1f154b6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:14.036486 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-b20eb090-8bc9-4da0-a092-1469e1f154b6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:14.045930 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b20eb090-8bc9-4da0-a092-1469e1f154b6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:14.046412 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b20eb090-8bc9-4da0-a092-1469e1f154b6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:14.047281 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b20eb090-8bc9-4da0-a092-1469e1f154b6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:14.047730 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-b20eb090-8bc9-4da0-a092-1469e1f154b6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:14.183276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-b20eb090-8bc9-4da0-a092-1469e1f154b6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:14.190871 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b20eb090-8bc9-4da0-a092-1469e1f154b6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.159164 Jun 22 18:51:14.191429 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 626/1199] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:14 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:15.208508 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c599169b-c8fa-42bf-9327-6c3176bac94b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:15.209192 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c599169b-c8fa-42bf-9327-6c3176bac94b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:15.216395 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c599169b-c8fa-42bf-9327-6c3176bac94b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:15.216840 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c599169b-c8fa-42bf-9327-6c3176bac94b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:15.217633 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c599169b-c8fa-42bf-9327-6c3176bac94b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:15.218060 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c599169b-c8fa-42bf-9327-6c3176bac94b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:15.358856 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c599169b-c8fa-42bf-9327-6c3176bac94b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:15.366763 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c599169b-c8fa-42bf-9327-6c3176bac94b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.162785 Jun 22 18:51:15.367331 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 574/1200] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:15 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:15.483772 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-fa9fca4a-36b3-457e-8a3d-a09080ab8eb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:15.484295 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-fa9fca4a-36b3-457e-8a3d-a09080ab8eb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:15.490418 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fa9fca4a-36b3-457e-8a3d-a09080ab8eb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:15.490964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fa9fca4a-36b3-457e-8a3d-a09080ab8eb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:15.491729 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fa9fca4a-36b3-457e-8a3d-a09080ab8eb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:15.492194 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fa9fca4a-36b3-457e-8a3d-a09080ab8eb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:15.515538 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-fa9fca4a-36b3-457e-8a3d-a09080ab8eb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a/ips" status: 200 len: 150 microversion: 2.1 time: 0.247844 Jun 22 18:51:15.516116 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 627/1201] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 18:51:15 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a/ips => generated 150 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:51:16.007806 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-3ac41a49-0a3c-4d4f-90f8-401cc675cd17 req-3650c711-5f72-428d-bee0-e783787aac20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1480f2-347e-427e-973a-273c41839863", "name": "network-vif-plugged", "status": "completed", "tag": "826cbcec-8cca-4af8-aaf9-db06515201a3"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:51:16.016074 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-3ac41a49-0a3c-4d4f-90f8-401cc675cd17 req-3650c711-5f72-428d-bee0-e783787aac20 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:16.016528 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-3ac41a49-0a3c-4d4f-90f8-401cc675cd17 req-3650c711-5f72-428d-bee0-e783787aac20 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:16.027177 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-3ac41a49-0a3c-4d4f-90f8-401cc675cd17 req-3650c711-5f72-428d-bee0-e783787aac20 service nova] Creating event network-vif-plugged:826cbcec-8cca-4af8-aaf9-db06515201a3 for instance 7b1480f2-347e-427e-973a-273c41839863 on hv-cinder-81268 Jun 22 18:51:16.032185 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-3ac41a49-0a3c-4d4f-90f8-401cc675cd17 req-3650c711-5f72-428d-bee0-e783787aac20 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091071 Jun 22 18:51:16.032766 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 575/1202] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:16.383491 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d4af9a77-7ddc-4efa-ae0f-31c3e343ca8d tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:16.384126 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d4af9a77-7ddc-4efa-ae0f-31c3e343ca8d tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:16.390915 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d4af9a77-7ddc-4efa-ae0f-31c3e343ca8d tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:16.391437 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d4af9a77-7ddc-4efa-ae0f-31c3e343ca8d tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:16.392313 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d4af9a77-7ddc-4efa-ae0f-31c3e343ca8d tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:16.392865 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d4af9a77-7ddc-4efa-ae0f-31c3e343ca8d tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:16.532396 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d4af9a77-7ddc-4efa-ae0f-31c3e343ca8d tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:16.540384 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d4af9a77-7ddc-4efa-ae0f-31c3e343ca8d tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.161804 Jun 22 18:51:16.540952 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 628/1203] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:16 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:16.836335 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-27a7124e-bd88-4846-b65a-f975ad80f147 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bebd43e-5547-4e81-9551-5a1a1cab46a8"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:51:16.837485 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-27a7124e-bd88-4846-b65a-f975ad80f147 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:16.845296 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-27a7124e-bd88-4846-b65a-f975ad80f147 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:16.845747 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-27a7124e-bd88-4846-b65a-f975ad80f147 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:16.846518 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-27a7124e-bd88-4846-b65a-f975ad80f147 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:16.847278 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-27a7124e-bd88-4846-b65a-f975ad80f147 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:17.346952 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-27a7124e-bd88-4846-b65a-f975ad80f147 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "POST /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515502 Jun 22 18:51:17.347561 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 576/1204] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:51:16 2022] POST /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:17.556446 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f1b4a8db-cdf1-4272-b16b-0f44aa0067f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:17.557076 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f1b4a8db-cdf1-4272-b16b-0f44aa0067f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:17.563513 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f1b4a8db-cdf1-4272-b16b-0f44aa0067f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:17.563996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f1b4a8db-cdf1-4272-b16b-0f44aa0067f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:17.564767 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f1b4a8db-cdf1-4272-b16b-0f44aa0067f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:17.565228 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f1b4a8db-cdf1-4272-b16b-0f44aa0067f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:17.716910 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f1b4a8db-cdf1-4272-b16b-0f44aa0067f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:17.724473 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f1b4a8db-cdf1-4272-b16b-0f44aa0067f8 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1258 microversion: 2.1 time: 0.171915 Jun 22 18:51:17.725771 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 629/1205] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:17 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:18.742045 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a57d216e-eac9-4ba5-91fe-b47a72a7f77b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:18.742892 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a57d216e-eac9-4ba5-91fe-b47a72a7f77b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:18.749289 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a57d216e-eac9-4ba5-91fe-b47a72a7f77b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:18.749732 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a57d216e-eac9-4ba5-91fe-b47a72a7f77b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:18.750502 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a57d216e-eac9-4ba5-91fe-b47a72a7f77b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:18.750925 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a57d216e-eac9-4ba5-91fe-b47a72a7f77b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:18.922264 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a57d216e-eac9-4ba5-91fe-b47a72a7f77b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:18.930887 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a57d216e-eac9-4ba5-91fe-b47a72a7f77b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1442 microversion: 2.1 time: 0.193685 Jun 22 18:51:18.931463 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 577/1206] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:18 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1442 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:18.950089 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5cc35f2a-ca34-43c2-a5a8-d9e4a81aa381 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:18.951285 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5cc35f2a-ca34-43c2-a5a8-d9e4a81aa381 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:18.958058 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5cc35f2a-ca34-43c2-a5a8-d9e4a81aa381 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:18.958612 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5cc35f2a-ca34-43c2-a5a8-d9e4a81aa381 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:18.959471 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5cc35f2a-ca34-43c2-a5a8-d9e4a81aa381 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:18.960369 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5cc35f2a-ca34-43c2-a5a8-d9e4a81aa381 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:19.104878 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5cc35f2a-ca34-43c2-a5a8-d9e4a81aa381 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:19.112641 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5cc35f2a-ca34-43c2-a5a8-d9e4a81aa381 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1442 microversion: 2.1 time: 0.169664 Jun 22 18:51:19.113195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 630/1207] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:18 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1442 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:21.262620 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-ac2f0530-5933-4cc1-a915-aeda78f7d0b9 req-f70268b5-b5b9-48b3-b909-b232840dc85a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b1480f2-347e-427e-973a-273c41839863", "tag": "826cbcec-8cca-4af8-aaf9-db06515201a3"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:51:21.271339 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-ac2f0530-5933-4cc1-a915-aeda78f7d0b9 req-f70268b5-b5b9-48b3-b909-b232840dc85a service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:21.271780 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-ac2f0530-5933-4cc1-a915-aeda78f7d0b9 req-f70268b5-b5b9-48b3-b909-b232840dc85a service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:21.285171 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-ac2f0530-5933-4cc1-a915-aeda78f7d0b9 req-f70268b5-b5b9-48b3-b909-b232840dc85a service nova] Creating event network-changed:826cbcec-8cca-4af8-aaf9-db06515201a3 for instance 7b1480f2-347e-427e-973a-273c41839863 on hv-cinder-81268 Jun 22 18:51:21.291137 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-ac2f0530-5933-4cc1-a915-aeda78f7d0b9 req-f70268b5-b5b9-48b3-b909-b232840dc85a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034747 Jun 22 18:51:21.291912 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 578/1208] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:25.020280 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9b637660-996c-4900-9593-e87d46cc94f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:25.020753 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9b637660-996c-4900-9593-e87d46cc94f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:25.028719 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9b637660-996c-4900-9593-e87d46cc94f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:25.029166 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9b637660-996c-4900-9593-e87d46cc94f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:25.030501 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9b637660-996c-4900-9593-e87d46cc94f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:25.032605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9b637660-996c-4900-9593-e87d46cc94f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:25.151776 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-9b637660-996c-4900-9593-e87d46cc94f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lazy-loading 'services' on Instance uuid 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:51:25.265001 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9b637660-996c-4900-9593-e87d46cc94f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a/os-volume_attachments/3bebd43e-5547-4e81-9551-5a1a1cab46a8" status: 202 len: 0 microversion: 2.1 time: 0.248489 Jun 22 18:51:25.265817 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 631/1209] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 18:51:25 2022] DELETE /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a/os-volume_attachments/3bebd43e-5547-4e81-9551-5a1a1cab46a8 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:51:25.276698 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-639ca239-b4f0-4627-bbad-f9067b4780a5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:25.278423 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-639ca239-b4f0-4627-bbad-f9067b4780a5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:25.286340 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-639ca239-b4f0-4627-bbad-f9067b4780a5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:25.287220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-639ca239-b4f0-4627-bbad-f9067b4780a5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:25.288635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-639ca239-b4f0-4627-bbad-f9067b4780a5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:25.289075 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-639ca239-b4f0-4627-bbad-f9067b4780a5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:25.331338 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-639ca239-b4f0-4627-bbad-f9067b4780a5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060803 Jun 22 18:51:25.332270 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 579/1210] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:51:25 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:26.345334 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-efdb9e68-b0af-4dda-890c-28cb301e6834 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:26.347266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-efdb9e68-b0af-4dda-890c-28cb301e6834 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:26.355031 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-efdb9e68-b0af-4dda-890c-28cb301e6834 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:26.355479 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-efdb9e68-b0af-4dda-890c-28cb301e6834 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:26.357251 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-efdb9e68-b0af-4dda-890c-28cb301e6834 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:26.358646 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-efdb9e68-b0af-4dda-890c-28cb301e6834 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:26.402102 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-efdb9e68-b0af-4dda-890c-28cb301e6834 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062832 Jun 22 18:51:26.407893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 632/1211] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:51:26 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 18:51:26.483614 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1add6bbb-9ec0-4a20-8b9f-c3a1bad6164b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:26.484824 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1add6bbb-9ec0-4a20-8b9f-c3a1bad6164b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:26.494831 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1add6bbb-9ec0-4a20-8b9f-c3a1bad6164b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:26.496312 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1add6bbb-9ec0-4a20-8b9f-c3a1bad6164b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:26.500121 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1add6bbb-9ec0-4a20-8b9f-c3a1bad6164b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:26.500773 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1add6bbb-9ec0-4a20-8b9f-c3a1bad6164b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:26.541060 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1add6bbb-9ec0-4a20-8b9f-c3a1bad6164b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Going to try to terminate instance {{(pid=129743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:51:26.680483 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1add6bbb-9ec0-4a20-8b9f-c3a1bad6164b tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 204 len: 0 microversion: 2.1 time: 0.202805 Jun 22 18:51:26.681087 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 580/1212] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:51:26 2022] DELETE /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:51:26.689449 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-eaf7a261-0791-47cc-b513-820f0c9ddf84 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:26.690065 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-eaf7a261-0791-47cc-b513-820f0c9ddf84 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:26.697118 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eaf7a261-0791-47cc-b513-820f0c9ddf84 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:26.697735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eaf7a261-0791-47cc-b513-820f0c9ddf84 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:26.698702 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eaf7a261-0791-47cc-b513-820f0c9ddf84 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:26.699146 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-eaf7a261-0791-47cc-b513-820f0c9ddf84 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:26.861080 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-eaf7a261-0791-47cc-b513-820f0c9ddf84 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:26.871208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-eaf7a261-0791-47cc-b513-820f0c9ddf84 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1682 microversion: 2.1 time: 0.185579 Jun 22 18:51:26.872138 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 633/1213] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:26 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:27.889642 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d30b0e45-8c12-4b94-95f9-b7afab3f2f38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:27.890566 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d30b0e45-8c12-4b94-95f9-b7afab3f2f38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:27.897608 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d30b0e45-8c12-4b94-95f9-b7afab3f2f38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:27.898167 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d30b0e45-8c12-4b94-95f9-b7afab3f2f38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:27.899152 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d30b0e45-8c12-4b94-95f9-b7afab3f2f38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:27.899790 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d30b0e45-8c12-4b94-95f9-b7afab3f2f38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:28.152218 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d30b0e45-8c12-4b94-95f9-b7afab3f2f38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:28.161374 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d30b0e45-8c12-4b94-95f9-b7afab3f2f38 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1682 microversion: 2.1 time: 0.275376 Jun 22 18:51:28.164438 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 581/1214] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:27 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1682 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:29.183763 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-27673e5f-4678-462b-a508-ffd68520f80d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:29.184442 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-27673e5f-4678-462b-a508-ffd68520f80d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:29.188059 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:29.192049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-27673e5f-4678-462b-a508-ffd68520f80d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:29.192510 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-27673e5f-4678-462b-a508-ffd68520f80d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:29.193301 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-27673e5f-4678-462b-a508-ffd68520f80d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:29.193812 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-27673e5f-4678-462b-a508-ffd68520f80d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:29.211088 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:29.555924 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-27673e5f-4678-462b-a508-ffd68520f80d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:29.566207 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-27673e5f-4678-462b-a508-ffd68520f80d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1682 microversion: 2.1 time: 0.388432 Jun 22 18:51:29.579524 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 634/1215] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:29 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1682 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:30.043122 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-c746ed22-69cb-4e1c-9f4c-7b72186eb077 req-67dedc3c-9756-4854-ae5b-2cc147685d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1f61d6-8ef7-4c84-8cc4-f38d1431084a", "name": "network-vif-deleted", "tag": "47b9f716-3d48-4026-a37b-1ea54f9474dd"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:51:30.056409 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:30.075113 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-c746ed22-69cb-4e1c-9f4c-7b72186eb077 req-67dedc3c-9756-4854-ae5b-2cc147685d22 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:30.076237 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-c746ed22-69cb-4e1c-9f4c-7b72186eb077 req-67dedc3c-9756-4854-ae5b-2cc147685d22 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:30.111685 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:30.117160 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-c746ed22-69cb-4e1c-9f4c-7b72186eb077 req-67dedc3c-9756-4854-ae5b-2cc147685d22 service nova] Creating event network-vif-deleted:47b9f716-3d48-4026-a37b-1ea54f9474dd for instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a on hv-cinder-81268 Jun 22 18:51:30.128576 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-c746ed22-69cb-4e1c-9f4c-7b72186eb077 req-67dedc3c-9756-4854-ae5b-2cc147685d22 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093312 Jun 22 18:51:30.130356 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 582/1216] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:30.586130 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5d61eca8-204d-4457-af81-498fbe1ad495 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:30.587357 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5d61eca8-204d-4457-af81-498fbe1ad495 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:30.602421 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5d61eca8-204d-4457-af81-498fbe1ad495 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:30.603186 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5d61eca8-204d-4457-af81-498fbe1ad495 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:30.605981 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5d61eca8-204d-4457-af81-498fbe1ad495 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:30.606420 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5d61eca8-204d-4457-af81-498fbe1ad495 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:30.684121 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5d61eca8-204d-4457-af81-498fbe1ad495 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:30.684491 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5d61eca8-204d-4457-af81-498fbe1ad495 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:30.684950 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-5d61eca8-204d-4457-af81-498fbe1ad495 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lazy-loading 'fault' on Instance uuid 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:51:30.745361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5d61eca8-204d-4457-af81-498fbe1ad495 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfa74308096d40daac0a67c9ebec8d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28351bd81f5f497a829c67c15bbb2f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:30.764281 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5d61eca8-204d-4457-af81-498fbe1ad495 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 200 len: 1332 microversion: 2.1 time: 0.183140 Jun 22 18:51:30.764874 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 635/1217] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:30 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 1332 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:31.743948 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 18:51:31.744810 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Wed Jun 22 18:51:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 18:51:31.783804 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ae3ef7e7-7189-4ca1-a670-2641ca21d34e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:31.784660 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ae3ef7e7-7189-4ca1-a670-2641ca21d34e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:31.793526 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ae3ef7e7-7189-4ca1-a670-2641ca21d34e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:31.793991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ae3ef7e7-7189-4ca1-a670-2641ca21d34e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:31.794822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ae3ef7e7-7189-4ca1-a670-2641ca21d34e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:31.795315 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ae3ef7e7-7189-4ca1-a670-2641ca21d34e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:31.814890 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-ae3ef7e7-7189-4ca1-a670-2641ca21d34e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ae3ef7e7-7189-4ca1-a670-2641ca21d34e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a HTTP/1.1 Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:51:31.816699 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:51:31.818402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:51:31.818402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:31.818402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:31.818402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:31.818402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:31.818402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:51:31.818402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:51:31.818402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:51:31.818402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:31.818402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:51:31.818402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:31.818402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '0d1f61d6-8ef7-4c84-8cc4-f38d1431084a'} Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:51:31.823126 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:31.826029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:31.829915 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ae3ef7e7-7189-4ca1-a670-2641ca21d34e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 404 to user: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:51:31.830799 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ae3ef7e7-7189-4ca1-a670-2641ca21d34e tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 404 len: 111 microversion: 2.1 time: 0.052653 Jun 22 18:51:31.831600 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 583/1218] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:31 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:31.841017 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6011567f-db7e-42e8-a464-5556a7a29e6f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '.version_select at 0x7fd75550a8b0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:31.866024 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6011567f-db7e-42e8-a464-5556a7a29e6f tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124317988" status: 202 len: 0 microversion: 2.1 time: 0.029901 Jun 22 18:51:31.870535 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 636/1219] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jun 22 18:51:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124317988 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:51:33.988706 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b70e6d63-c0cf-403d-912a-53880c4b5503 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:33.994234 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b70e6d63-c0cf-403d-912a-53880c4b5503 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:34.001704 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b70e6d63-c0cf-403d-912a-53880c4b5503 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:34.002636 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b70e6d63-c0cf-403d-912a-53880c4b5503 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:34.003638 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b70e6d63-c0cf-403d-912a-53880c4b5503 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:34.004604 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b70e6d63-c0cf-403d-912a-53880c4b5503 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:34.030942 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-b70e6d63-c0cf-403d-912a-53880c4b5503 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b70e6d63-c0cf-403d-912a-53880c4b5503 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: DELETE /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a HTTP/1.1 Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:51:34.032742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:51:34.034139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:51:34.034139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:34.034139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:34.034139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:34.034139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:34.034139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:51:34.034139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:51:34.034139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:51:34.034139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:34.034139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:51:34.034139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:34.034139 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '0d1f61d6-8ef7-4c84-8cc4-f38d1431084a'} Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:51:34.034969 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:34.036309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:34.041390 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b70e6d63-c0cf-403d-912a-53880c4b5503 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 404 to user: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:51:34.042397 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b70e6d63-c0cf-403d-912a-53880c4b5503 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 404 len: 111 microversion: 2.1 time: 0.058742 Jun 22 18:51:34.043063 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 584/1220] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:51:33 2022] DELETE /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:34.051312 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-43d54094-168c-4cf5-abb2-c63c612348f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:34.051954 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-43d54094-168c-4cf5-abb2-c63c612348f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:34.062279 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43d54094-168c-4cf5-abb2-c63c612348f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:34.062710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43d54094-168c-4cf5-abb2-c63c612348f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:34.065419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43d54094-168c-4cf5-abb2-c63c612348f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:34.065868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43d54094-168c-4cf5-abb2-c63c612348f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:34.082491 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-43d54094-168c-4cf5-abb2-c63c612348f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-43d54094-168c-4cf5-abb2-c63c612348f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a HTTP/1.1 Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:51:34.084213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:51:34.085832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:51:34.085832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:34.085832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:34.085832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:34.085832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:34.085832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:51:34.085832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:51:34.085832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:51:34.085832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:34.085832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:51:34.085832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:34.085832 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '0d1f61d6-8ef7-4c84-8cc4-f38d1431084a'} Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:51:34.086974 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. Jun 22 18:51:34.088565 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:34.091394 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-43d54094-168c-4cf5-abb2-c63c612348f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 404 to user: Instance 0d1f61d6-8ef7-4c84-8cc4-f38d1431084a could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:51:34.092472 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-43d54094-168c-4cf5-abb2-c63c612348f1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a" status: 404 len: 111 microversion: 2.1 time: 0.045249 Jun 22 18:51:34.094176 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 637/1221] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:34 2022] GET /compute/v2.1/servers/0d1f61d6-8ef7-4c84-8cc4-f38d1431084a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:35.277876 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-fc9c2b75-908a-47d8-a434-c0181b5a49f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:35.278995 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-fc9c2b75-908a-47d8-a434-c0181b5a49f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:35.286391 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fc9c2b75-908a-47d8-a434-c0181b5a49f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:35.287106 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fc9c2b75-908a-47d8-a434-c0181b5a49f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:35.288750 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fc9c2b75-908a-47d8-a434-c0181b5a49f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:35.289190 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-fc9c2b75-908a-47d8-a434-c0181b5a49f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:35.303392 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-fc9c2b75-908a-47d8-a434-c0181b5a49f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-fc9c2b75-908a-47d8-a434-c0181b5a49f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: DELETE /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 HTTP/1.1 Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:51:35.305202 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:51:35.308040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:51:35.308040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:35.308040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:35.308040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:35.308040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:35.308040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:51:35.308040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:51:35.308040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:51:35.308040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:35.308040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:51:35.308040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:51:35.308040 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': 'e9b8c26d-8d82-435d-b4c7-98f8ced7d279'} Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:51:35.308894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:51:35.310166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.311498 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-fc9c2b75-908a-47d8-a434-c0181b5a49f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 404 to user: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:51:35.311498 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-fc9c2b75-908a-47d8-a434-c0181b5a49f5 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 404 len: 111 microversion: 2.1 time: 0.032744 Jun 22 18:51:35.311498 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 585/1222] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:51:35 2022] DELETE /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:35.317002 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-88e9b447-07b2-4714-ad5a-afd82196edb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:35.317797 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-88e9b447-07b2-4714-ad5a-afd82196edb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: e9b8c26d-8d82-435d-b4c7-98f8ced7d279] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:35.324774 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-88e9b447-07b2-4714-ad5a-afd82196edb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:35.325345 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-88e9b447-07b2-4714-ad5a-afd82196edb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:35.326192 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-88e9b447-07b2-4714-ad5a-afd82196edb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:35.326724 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-88e9b447-07b2-4714-ad5a-afd82196edb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:35.344405 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-88e9b447-07b2-4714-ad5a-afd82196edb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-88e9b447-07b2-4714-ad5a-afd82196edb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 HTTP/1.1 Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:51:35.346371 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:51:35.348049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:51:35.348049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:35.348049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:35.348049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:35.348049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:35.348049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:51:35.348049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:51:35.348049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:51:35.348049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:35.348049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:51:35.348049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:51:35.348049 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': 'e9b8c26d-8d82-435d-b4c7-98f8ced7d279'} Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:51:35.348996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. Jun 22 18:51:35.350839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.353148 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-88e9b447-07b2-4714-ad5a-afd82196edb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 404 to user: Instance e9b8c26d-8d82-435d-b4c7-98f8ced7d279 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:51:35.354665 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-88e9b447-07b2-4714-ad5a-afd82196edb1 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279" status: 404 len: 111 microversion: 2.1 time: 0.041253 Jun 22 18:51:35.355642 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 638/1223] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:35 2022] GET /compute/v2.1/servers/e9b8c26d-8d82-435d-b4c7-98f8ced7d279 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:35.363720 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c0cc670b-3c0e-41e9-94bb-fca8ea13a28d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:35.364387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c0cc670b-3c0e-41e9-94bb-fca8ea13a28d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:35.373933 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c0cc670b-3c0e-41e9-94bb-fca8ea13a28d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:35.375114 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c0cc670b-3c0e-41e9-94bb-fca8ea13a28d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:35.376602 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c0cc670b-3c0e-41e9-94bb-fca8ea13a28d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:35.377737 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c0cc670b-3c0e-41e9-94bb-fca8ea13a28d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:35.404619 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-c0cc670b-3c0e-41e9-94bb-fca8ea13a28d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c0cc670b-3c0e-41e9-94bb-fca8ea13a28d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: DELETE /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 HTTP/1.1 Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:51:35.406342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:51:35.407749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:51:35.407749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:35.407749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:35.407749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:35.407749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:35.407749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:51:35.407749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:51:35.407749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:51:35.407749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:35.407749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:51:35.407749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:51:35.407749 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': 'd5f0f5e4-c6a6-4716-8f93-a67aaea48fa2'} Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:51:35.408553 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:51:35.409921 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.412889 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c0cc670b-3c0e-41e9-94bb-fca8ea13a28d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 404 to user: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:51:35.414006 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c0cc670b-3c0e-41e9-94bb-fca8ea13a28d tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 404 len: 111 microversion: 2.1 time: 0.054352 Jun 22 18:51:35.415146 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 586/1224] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:51:35 2022] DELETE /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:35.422664 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-649102d5-0a55-496d-8663-b346f6f5cd60 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:35.423272 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-649102d5-0a55-496d-8663-b346f6f5cd60 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:35.433661 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-649102d5-0a55-496d-8663-b346f6f5cd60 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:35.434279 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-649102d5-0a55-496d-8663-b346f6f5cd60 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:35.435250 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-649102d5-0a55-496d-8663-b346f6f5cd60 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:35.435687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-649102d5-0a55-496d-8663-b346f6f5cd60 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:35.453164 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-649102d5-0a55-496d-8663-b346f6f5cd60 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-649102d5-0a55-496d-8663-b346f6f5cd60 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 HTTP/1.1 Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:51:35.455054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:51:35.456500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:51:35.456500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:35.456500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:35.456500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:35.456500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:35.456500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:51:35.456500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:51:35.456500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:51:35.456500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:35.456500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:51:35.456500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:51:35.456500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': 'd5f0f5e4-c6a6-4716-8f93-a67aaea48fa2'} Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:51:35.457305 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. Jun 22 18:51:35.459023 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:35.460472 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-649102d5-0a55-496d-8663-b346f6f5cd60 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 404 to user: Instance d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:51:35.460472 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-649102d5-0a55-496d-8663-b346f6f5cd60 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2" status: 404 len: 111 microversion: 2.1 time: 0.037760 Jun 22 18:51:35.460472 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 639/1225] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:35 2022] GET /compute/v2.1/servers/d5f0f5e4-c6a6-4716-8f93-a67aaea48fa2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:36.688927 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-83ab331c-4c6b-48c4-8479-202b99f7bafd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:36.690404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-83ab331c-4c6b-48c4-8479-202b99f7bafd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:36.710517 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-83ab331c-4c6b-48c4-8479-202b99f7bafd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:36.711546 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-83ab331c-4c6b-48c4-8479-202b99f7bafd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:36.733451 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-83ab331c-4c6b-48c4-8479-202b99f7bafd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:36.733931 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-83ab331c-4c6b-48c4-8479-202b99f7bafd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:36.758391 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-83ab331c-4c6b-48c4-8479-202b99f7bafd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-83ab331c-4c6b-48c4-8479-202b99f7bafd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: DELETE /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc HTTP/1.1 Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:51:36.759994 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:51:36.761758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:51:36.761758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:36.761758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:36.761758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:36.761758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:36.761758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:51:36.761758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:51:36.761758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:51:36.761758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:36.761758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:51:36.761758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:51:36.761758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc'} Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:51:36.762738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:51:36.764317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:36.765899 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-83ab331c-4c6b-48c4-8479-202b99f7bafd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 404 to user: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:51:36.765899 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-83ab331c-4c6b-48c4-8479-202b99f7bafd tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 404 len: 111 microversion: 2.1 time: 0.083683 Jun 22 18:51:36.773468 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-da8918b1-8b0d-40b0-99eb-fbcee979a408 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:36.773468 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-da8918b1-8b0d-40b0-99eb-fbcee979a408 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] [instance: 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:36.786343 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-da8918b1-8b0d-40b0-99eb-fbcee979a408 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:36.786800 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-da8918b1-8b0d-40b0-99eb-fbcee979a408 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:36.787766 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-da8918b1-8b0d-40b0-99eb-fbcee979a408 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:36.788219 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-da8918b1-8b0d-40b0-99eb-fbcee979a408 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:36.790985 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 587/1226] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:51:36 2022] DELETE /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:36.805490 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-da8918b1-8b0d-40b0-99eb-fbcee979a408 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] HTTP exception thrown: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-da8918b1-8b0d-40b0-99eb-fbcee979a408 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Request method failure captured: Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc HTTP/1.1 Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2IluoPNvQIbSBSvrItC-u7A4W0bEBYAEUMv32-lwFTy2h_ofcZdhOh4bTCYIQbLAIPmpY9vsQr7oFustRhn68P3UbngVzHyeCE69FCSIBj-ZTNuPqNsc0-TtwjEbbd2NgSPe7iN1XvlDxnCfQ9SVfKTIKevsSlD7CYvuGb_kVxXTOo Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:51:36.807195 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:51:36.808706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_28351bd81f5f497a829c67c15bbb2f09", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/28351bd81f5f497a829c67c15bbb2f09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:51:36.808706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:36.808706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 28351bd81f5f497a829c67c15bbb2f09 Jun 22 18:51:36.808706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1669024125 Jun 22 18:51:36.808706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:36.808706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:51:36.808706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:51:36.808706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: bfa74308096d40daac0a67c9ebec8d8d Jun 22 18:51:36.808706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-AttachVolumeNegativeTest-1669024125-project Jun 22 18:51:36.808706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:51:36.808706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:51:36.808706 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc'} Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:51:36.813536 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. Jun 22 18:51:36.815695 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:36.817164 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-da8918b1-8b0d-40b0-99eb-fbcee979a408 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] Returning 404 to user: Instance 3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:51:36.817164 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-da8918b1-8b0d-40b0-99eb-fbcee979a408 tempest-AttachVolumeNegativeTest-1669024125 tempest-AttachVolumeNegativeTest-1669024125-project] 10.222.0.18 "GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc" status: 404 len: 111 microversion: 2.1 time: 0.043028 Jun 22 18:51:36.817164 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 640/1227] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:36 2022] GET /compute/v2.1/servers/3e6f5cb1-5d0c-45eb-8412-de0fcd230fcc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:41.307810 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7a9d8cdc-d9bb-41b3-8f46-475ece337bd2 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Action: 'create', calling method: .version_select at 0x7fd757d813a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-889233669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG9MM/01wSrvCefzctXWFdEVK8So+88NXekzrhiJMtusAgUhRwkCD8uEsgrJ9knJWwArYoWR+W/W0wmpAKbBnSSGYumw2aKJo2jGs7HjDCHuduYmzEz3eo1tmytfBKi6w=="}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:51:41.325302 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-7a9d8cdc-d9bb-41b3-8f46-475ece337bd2 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Getting quotas for project 6be45c6791274b4c9f58753498a1684d. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:51:41.336162 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.quota [None req-7a9d8cdc-d9bb-41b3-8f46-475ece337bd2 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Getting quotas for user b183452d65b94bb0b0ce507cc9db4d08 and project 6be45c6791274b4c9f58753498a1684d. Resources: {'key_pairs'} {{(pid=129743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:51:41.374682 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7a9d8cdc-d9bb-41b3-8f46-475ece337bd2 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.071836 Jun 22 18:51:41.375274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 588/1228] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 22 18:51:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:41.451174 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2141560335", "imageRef": "879717a8-99f2-4252-9f45-8d1a0cbb2006", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-889233669", "networks": [{"uuid": "5507289d-e1db-4601-bd44-46334131e565"}]}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:51:41.508986 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.network.neutron [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] validate_networks() for [('5507289d-e1db-4601-bd44-46334131e565', None, None, None, None, None)] {{(pid=129744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 18:51:41.950742 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Flavor limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 18:51:41.951405 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Image limits 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 18:51:41.951893 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Flavor pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 18:51:41.952298 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Image pref 0:0:0 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 18:51:41.952699 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.virt.hardware [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 18:51:41.961658 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:41.962096 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:41.962884 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:41.963313 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:41.980328 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Getting quotas for project 6be45c6791274b4c9f58753498a1684d. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 18:51:41.984366 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.quota [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Getting quotas for user b183452d65b94bb0b0ce507cc9db4d08 and project 6be45c6791274b4c9f58753498a1684d. Resources: {'cores', 'instances', 'ram'} {{(pid=129744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 18:51:41.995651 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Going to run 1 instances... {{(pid=129744) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 18:51:41.997861 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='879717a8-99f2-4252-9f45-8d1a0cbb2006',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 18:51:42.042521 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-527e6177-d7c1-413d-b943-a9fce7d02279 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595242 Jun 22 18:51:42.043157 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 641/1229] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 22 18:51:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 18:51:42.053895 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b0521f02-005e-4f16-b271-99d4d977a57f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:42.054989 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b0521f02-005e-4f16-b271-99d4d977a57f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:42.137708 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b0521f02-005e-4f16-b271-99d4d977a57f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:42.144048 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b0521f02-005e-4f16-b271-99d4d977a57f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1258 microversion: 2.1 time: 0.094645 Jun 22 18:51:42.144578 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 589/1230] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:42 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1258 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:42.839526 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-91fbcf9d-128b-4a86-b20a-0acdf427c6df tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Action: 'create', calling method: .version_select at 0x7fd7554f2a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-565713494"}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:51:43.141281 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-91fbcf9d-128b-4a86-b20a-0acdf427c6df tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.420347 Jun 22 18:51:43.142173 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 642/1231] 10.222.0.18 () {60 vars in 1154 bytes} [Wed Jun 22 18:51:42 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 423 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 18:51:43.152984 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-caad9ad5-1c0a-47af-8b60-65deab532458 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd7556869d0>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:43.161992 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9d310b54-0555-44ef-9160-98c73059e249 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:43.163393 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9d310b54-0555-44ef-9160-98c73059e249 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:43.175109 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9d310b54-0555-44ef-9160-98c73059e249 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:43.175562 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9d310b54-0555-44ef-9160-98c73059e249 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:43.176431 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9d310b54-0555-44ef-9160-98c73059e249 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:43.176874 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9d310b54-0555-44ef-9160-98c73059e249 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:43.226184 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-caad9ad5-1c0a-47af-8b60-65deab532458 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88" status: 200 len: 344 microversion: 2.1 time: 0.076605 Jun 22 18:51:43.226955 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 590/1232] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:51:43 2022] GET /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:43.248253 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9d310b54-0555-44ef-9160-98c73059e249 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:43.256604 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9d310b54-0555-44ef-9160-98c73059e249 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1318 microversion: 2.1 time: 0.098571 Jun 22 18:51:43.257170 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 643/1233] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:43 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:44.239149 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1e50cd1c-8a32-4839-8532-2438e463f718 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd7558d3160>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:44.274177 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4a3e2617-53ac-46ca-9b74-cbe66e9219d9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:44.275446 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4a3e2617-53ac-46ca-9b74-cbe66e9219d9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:44.282817 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a3e2617-53ac-46ca-9b74-cbe66e9219d9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:44.283569 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a3e2617-53ac-46ca-9b74-cbe66e9219d9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:44.284555 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a3e2617-53ac-46ca-9b74-cbe66e9219d9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:44.284991 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a3e2617-53ac-46ca-9b74-cbe66e9219d9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:44.347898 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1e50cd1c-8a32-4839-8532-2438e463f718 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88" status: 200 len: 345 microversion: 2.1 time: 0.113028 Jun 22 18:51:44.355957 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 591/1234] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:51:44 2022] GET /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88 => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:44.362111 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ff53a179-ec56-412f-93a5-7e1a85d7c69a tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Action: 'create', calling method: .version_select at 0x7fd7558f3ee0>, body: {"snapshot": {"volume_id": "729632b8-e445-443f-8ebf-834bc4cd5d88", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1133425241"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:51:44.538397 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-4a3e2617-53ac-46ca-9b74-cbe66e9219d9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:44.547146 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4a3e2617-53ac-46ca-9b74-cbe66e9219d9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.277265 Jun 22 18:51:44.548849 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 644/1235] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:44 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:51:44.607585 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ff53a179-ec56-412f-93a5-7e1a85d7c69a tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.250158 Jun 22 18:51:44.608316 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 592/1236] 10.222.0.18 () {60 vars in 1161 bytes} [Wed Jun 22 18:51:44 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:44.621214 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-3015ad26-a704-4624-b41f-2eb6f3c1c4d8 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd75555a0d0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:44.675858 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-3015ad26-a704-4624-b41f-2eb6f3c1c4d8 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d" status: 200 len: 287 microversion: 2.1 time: 0.061430 Jun 22 18:51:44.676559 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 645/1237] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 18:51:44 2022] GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:51:44.686601 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-64603aae-175d-4c93-b3f0-c945d91506ce tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd7557820d0>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:44.726578 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-64603aae-175d-4c93-b3f0-c945d91506ce tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.043687 Jun 22 18:51:44.727544 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 593/1238] 10.222.0.18 () {58 vars in 1139 bytes} [Wed Jun 22 18:51:44 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:44.737563 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-eb0820a9-46c8-4ae9-b05a-3d8767440002 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd755fc3ca0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:44.771056 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-eb0820a9-46c8-4ae9-b05a-3d8767440002 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d" status: 200 len: 287 microversion: 2.1 time: 0.037168 Jun 22 18:51:44.772713 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 646/1239] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 18:51:44 2022] GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:45.568838 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5b4f100d-6a01-41f1-922b-bd953ff272ce tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:45.569967 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5b4f100d-6a01-41f1-922b-bd953ff272ce tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:45.576221 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5b4f100d-6a01-41f1-922b-bd953ff272ce tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:45.576667 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5b4f100d-6a01-41f1-922b-bd953ff272ce tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:45.577417 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5b4f100d-6a01-41f1-922b-bd953ff272ce tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:45.577842 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5b4f100d-6a01-41f1-922b-bd953ff272ce tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:45.716738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5b4f100d-6a01-41f1-922b-bd953ff272ce tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:45.724554 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5b4f100d-6a01-41f1-922b-bd953ff272ce tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.160004 Jun 22 18:51:45.725112 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 594/1240] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:45 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:45.783190 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-dda49da8-a6b7-435d-8692-4989fec9345d tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd75550a3a0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:45.814216 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-dda49da8-a6b7-435d-8692-4989fec9345d tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d" status: 200 len: 287 microversion: 2.1 time: 0.035238 Jun 22 18:51:45.814780 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 647/1241] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 18:51:45 2022] GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:46.743207 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-abaa5b6e-9810-4506-b96c-cd3eadf43936 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:46.743814 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-abaa5b6e-9810-4506-b96c-cd3eadf43936 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:46.750394 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-abaa5b6e-9810-4506-b96c-cd3eadf43936 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:46.750836 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-abaa5b6e-9810-4506-b96c-cd3eadf43936 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:46.751589 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-abaa5b6e-9810-4506-b96c-cd3eadf43936 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:46.752053 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-abaa5b6e-9810-4506-b96c-cd3eadf43936 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:46.827137 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-be25a5ed-9b0e-47ab-b391-26885820bd27 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd7554f25e0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:46.858515 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-be25a5ed-9b0e-47ab-b391-26885820bd27 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d" status: 200 len: 287 microversion: 2.1 time: 0.035225 Jun 22 18:51:46.859159 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 648/1242] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 18:51:46 2022] GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:46.902743 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-abaa5b6e-9810-4506-b96c-cd3eadf43936 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:46.910317 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-abaa5b6e-9810-4506-b96c-cd3eadf43936 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.171723 Jun 22 18:51:46.910880 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 595/1243] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:46 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:47.871964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8c42ecee-fa08-4047-a166-16a8c1ae24b3 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd7554ceca0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:47.900751 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8c42ecee-fa08-4047-a166-16a8c1ae24b3 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d" status: 200 len: 287 microversion: 2.1 time: 0.033086 Jun 22 18:51:47.901297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 649/1244] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 18:51:47 2022] GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:47.928238 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-991e2dea-c1ee-4c5c-bbbe-5b1da7b9d30f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:47.930923 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-991e2dea-c1ee-4c5c-bbbe-5b1da7b9d30f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:47.939136 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-991e2dea-c1ee-4c5c-bbbe-5b1da7b9d30f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:47.939585 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-991e2dea-c1ee-4c5c-bbbe-5b1da7b9d30f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:47.940440 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-991e2dea-c1ee-4c5c-bbbe-5b1da7b9d30f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:47.940864 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-991e2dea-c1ee-4c5c-bbbe-5b1da7b9d30f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:48.072787 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-991e2dea-c1ee-4c5c-bbbe-5b1da7b9d30f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:48.080258 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-991e2dea-c1ee-4c5c-bbbe-5b1da7b9d30f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.155961 Jun 22 18:51:48.080822 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 596/1245] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:47 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:48.912434 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6a59910f-ac26-440f-a049-473eca672390 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd7555b3040>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:48.941498 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6a59910f-ac26-440f-a049-473eca672390 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d" status: 200 len: 287 microversion: 2.1 time: 0.033591 Jun 22 18:51:48.942062 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 650/1246] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 18:51:48 2022] GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:49.096752 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3768b77d-0249-438b-b4d0-e9fb4b1dbc82 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:49.097463 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-3768b77d-0249-438b-b4d0-e9fb4b1dbc82 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:49.104581 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3768b77d-0249-438b-b4d0-e9fb4b1dbc82 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:49.104801 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3768b77d-0249-438b-b4d0-e9fb4b1dbc82 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:49.105518 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3768b77d-0249-438b-b4d0-e9fb4b1dbc82 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:49.105959 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-3768b77d-0249-438b-b4d0-e9fb4b1dbc82 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:49.263562 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-3768b77d-0249-438b-b4d0-e9fb4b1dbc82 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:49.271645 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3768b77d-0249-438b-b4d0-e9fb4b1dbc82 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.178632 Jun 22 18:51:49.272422 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 597/1247] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:49 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:49.954037 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0ac6fe36-b316-4c67-9b35-3acf8f87bf51 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd755e5bb80>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:49.985284 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0ac6fe36-b316-4c67-9b35-3acf8f87bf51 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d" status: 200 len: 287 microversion: 2.1 time: 0.035457 Jun 22 18:51:49.985851 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 651/1248] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 18:51:49 2022] GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:51:50.290499 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-1de8851c-596f-4968-b2b4-e7be6640bf0c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:50.291106 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-1de8851c-596f-4968-b2b4-e7be6640bf0c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:50.297736 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1de8851c-596f-4968-b2b4-e7be6640bf0c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:50.298180 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1de8851c-596f-4968-b2b4-e7be6640bf0c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:50.298938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1de8851c-596f-4968-b2b4-e7be6640bf0c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:50.299373 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-1de8851c-596f-4968-b2b4-e7be6640bf0c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:50.427785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-1de8851c-596f-4968-b2b4-e7be6640bf0c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:50.436663 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-1de8851c-596f-4968-b2b4-e7be6640bf0c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.150868 Jun 22 18:51:50.437239 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 598/1249] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:50 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:50.996683 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6b0fc4cf-34dd-4b8f-a63a-a38766586689 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd75550ac10>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:51.028489 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6b0fc4cf-34dd-4b8f-a63a-a38766586689 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d" status: 200 len: 287 microversion: 2.1 time: 0.036003 Jun 22 18:51:51.029213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 652/1250] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 18:51:50 2022] GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:51.454848 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-03b16c5e-e129-4566-8a74-b870f253d25f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:51.455654 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-03b16c5e-e129-4566-8a74-b870f253d25f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:51.467942 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-03b16c5e-e129-4566-8a74-b870f253d25f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:51.468391 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-03b16c5e-e129-4566-8a74-b870f253d25f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:51.469181 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-03b16c5e-e129-4566-8a74-b870f253d25f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:51.469617 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-03b16c5e-e129-4566-8a74-b870f253d25f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:51.623742 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-03b16c5e-e129-4566-8a74-b870f253d25f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:51.631717 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-03b16c5e-e129-4566-8a74-b870f253d25f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.180803 Jun 22 18:51:51.632484 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 599/1251] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:51 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:52.039078 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:52.040045 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell0:SELECT=6 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:52.045558 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-dc0914d6-da36-4fcd-add6-890e89739118 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd755ec3670>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:52.079020 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-dc0914d6-da36-4fcd-add6-890e89739118 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d" status: 200 len: 288 microversion: 2.1 time: 0.041255 Jun 22 18:51:52.085212 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 653/1252] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 18:51:52 2022] GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d => generated 288 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:52.092081 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a7500d53-6a23-439c-b787-5c9864a8e755 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd755878670>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:52.143560 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=6 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:52.151296 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a7500d53-6a23-439c-b787-5c9864a8e755 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d" status: 202 len: 0 microversion: 2.1 time: 0.065061 Jun 22 18:51:52.152111 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 600/1253] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Jun 22 18:51:52 2022] DELETE /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:51:52.160162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-77d9612b-82ba-45c1-bd1a-faa56ef62bab tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd755fc3b80>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:52.190422 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-77d9612b-82ba-45c1-bd1a-faa56ef62bab tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d" status: 200 len: 287 microversion: 2.1 time: 0.033995 Jun 22 18:51:52.190989 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 654/1254] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 18:51:52 2022] GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:52.654109 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-951b969c-ae95-4901-9496-6e3c6932a1ea tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:52.654647 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-951b969c-ae95-4901-9496-6e3c6932a1ea tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:52.660893 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-951b969c-ae95-4901-9496-6e3c6932a1ea tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:52.661660 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-951b969c-ae95-4901-9496-6e3c6932a1ea tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:52.662665 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-951b969c-ae95-4901-9496-6e3c6932a1ea tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:52.663570 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-951b969c-ae95-4901-9496-6e3c6932a1ea tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:52.820279 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-951b969c-ae95-4901-9496-6e3c6932a1ea tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:52.827988 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-951b969c-ae95-4901-9496-6e3c6932a1ea tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.178202 Jun 22 18:51:52.828657 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 601/1255] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:52 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:53.203208 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1c8bc9be-7efb-4640-8111-93616d8f7e60 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd755476430>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:53.233506 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-1c8bc9be-7efb-4640-8111-93616d8f7e60 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] HTTP exception thrown: Snapshot 7755a165-dea5-410d-8880-0be2285d5e4d could not be found. Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1c8bc9be-7efb-4640-8111-93616d8f7e60 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Request method failure captured: Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d HTTP/1.1 Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2S-x52PathnwiwFP6URa3d1VRD0b_EV1pdZ6JGqLkGVmxxF0zsu6Yh66xXMcTOkOYUhiG7vAX9BUFrTvnCdVHbUWhPLV1KHbvsaj23_UUXVPAUUiFur8JStiPfsl7qCTiHBUJfPGhTg6kTDAEKBuVY5MdrRS-3-GVq17r97C38yEl4 Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 4549b943b3ae4304ace38051cc0e4ef0 Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-605574526 Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:51:53.235960 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:51:53.237718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4549b943b3ae4304ace38051cc0e4ef0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4549b943b3ae4304ace38051cc0e4ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4549b943b3ae4304ace38051cc0e4ef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4549b943b3ae4304ace38051cc0e4ef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:51:53.237718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-VolumesSnapshotsTestJSON-605574526 Jun 22 18:51:53.237718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 4549b943b3ae4304ace38051cc0e4ef0 Jun 22 18:51:53.237718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-605574526 Jun 22 18:51:53.237718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-VolumesSnapshotsTestJSON-605574526-project Jun 22 18:51:53.237718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:51:53.237718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:51:53.237718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 17f890210c4c48f7a5edddd27ad9135d Jun 22 18:51:53.237718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-VolumesSnapshotsTestJSON-605574526-project Jun 22 18:51:53.237718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: Jun 22 18:51:53.237718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Snapshot 7755a165-dea5-410d-8880-0be2285d5e4d could not be found. Jun 22 18:51:53.237718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '7755a165-dea5-410d-8880-0be2285d5e4d'} Jun 22 18:51:53.237718 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7755a165-dea5-410d-8880-0be2285d5e4d could not be found. (HTTP 404) (Request-ID: req-5e65ee4a-54f2-4091-b5be-bb47a6d920ef) Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:53.243167 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 18:51:53.244735 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7755a165-dea5-410d-8880-0be2285d5e4d could not be found. Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 22 18:51:53.246264 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:51:53.247855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7755a165-dea5-410d-8880-0be2285d5e4d could not be found. Jun 22 18:51:53.247855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:53.247855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:53.247855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:53.247855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:53.247855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:53.247855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:53.247855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:51:53.247855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:51:53.247855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7755a165-dea5-410d-8880-0be2285d5e4d could not be found. Jun 22 18:51:53.247855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:53.247855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1c8bc9be-7efb-4640-8111-93616d8f7e60 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Returning 404 to user: Snapshot 7755a165-dea5-410d-8880-0be2285d5e4d could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:51:53.247855 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-1c8bc9be-7efb-4640-8111-93616d8f7e60 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d" status: 404 len: 111 microversion: 2.1 time: 0.039082 Jun 22 18:51:53.248918 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 655/1256] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 22 18:51:53 2022] GET /compute/v2.1/os-snapshots/7755a165-dea5-410d-8880-0be2285d5e4d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:53.254954 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-3a67a03a-3ff4-4cdb-97c5-8e046c5c1328 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd7556daee0>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:53.316094 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-3a67a03a-3ff4-4cdb-97c5-8e046c5c1328 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88" status: 202 len: 0 microversion: 2.1 time: 0.065794 Jun 22 18:51:53.316668 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 602/1257] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 18:51:53 2022] DELETE /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:51:53.327790 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8b7abcce-4fbd-4c0c-b652-a8d3035cf9b0 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd7554f2550>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:53.395745 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8b7abcce-4fbd-4c0c-b652-a8d3035cf9b0 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88" status: 200 len: 344 microversion: 2.1 time: 0.073826 Jun 22 18:51:53.396356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 656/1258] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:51:53 2022] GET /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88 => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:53.845540 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b1529041-25fe-417d-b73b-e74cddbdc4a7 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:53.846104 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b1529041-25fe-417d-b73b-e74cddbdc4a7 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:53.853333 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b1529041-25fe-417d-b73b-e74cddbdc4a7 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:53.853780 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b1529041-25fe-417d-b73b-e74cddbdc4a7 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:53.854557 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b1529041-25fe-417d-b73b-e74cddbdc4a7 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:53.854996 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b1529041-25fe-417d-b73b-e74cddbdc4a7 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:53.991155 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b1529041-25fe-417d-b73b-e74cddbdc4a7 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:53.999093 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b1529041-25fe-417d-b73b-e74cddbdc4a7 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.157946 Jun 22 18:51:53.999657 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 603/1259] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:53 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:54.405068 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:54.410957 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-17955714-36ac-48ce-b3db-d05b8163f89f tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd75555e430>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:54.446559 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-17955714-36ac-48ce-b3db-d05b8163f89f tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] HTTP exception thrown: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-17955714-36ac-48ce-b3db-d05b8163f89f tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Request method failure captured: Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88 HTTP/1.1 Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2S-x52PathnwiwFP6URa3d1VRD0b_EV1pdZ6JGqLkGVmxxF0zsu6Yh66xXMcTOkOYUhiG7vAX9BUFrTvnCdVHbUWhPLV1KHbvsaj23_UUXVPAUUiFur8JStiPfsl7qCTiHBUJfPGhTg6kTDAEKBuVY5MdrRS-3-GVq17r97C38yEl4 Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 4549b943b3ae4304ace38051cc0e4ef0 Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-605574526 Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:51:54.448556 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:51:54.450297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4549b943b3ae4304ace38051cc0e4ef0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4549b943b3ae4304ace38051cc0e4ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4549b943b3ae4304ace38051cc0e4ef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4549b943b3ae4304ace38051cc0e4ef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:51:54.450297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-VolumesSnapshotsTestJSON-605574526 Jun 22 18:51:54.450297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 4549b943b3ae4304ace38051cc0e4ef0 Jun 22 18:51:54.450297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-605574526 Jun 22 18:51:54.450297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-VolumesSnapshotsTestJSON-605574526-project Jun 22 18:51:54.450297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:51:54.450297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:51:54.450297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 17f890210c4c48f7a5edddd27ad9135d Jun 22 18:51:54.450297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-VolumesSnapshotsTestJSON-605574526-project Jun 22 18:51:54.450297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: Jun 22 18:51:54.450297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.450297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '729632b8-e445-443f-8ebf-834bc4cd5d88'} Jun 22 18:51:54.450297 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. (HTTP 404) (Request-ID: req-fc4f067b-72a3-4ba3-a9c9-fb41da26e2ea) Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:54.451601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 18:51:54.453266 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 18:51:54.454727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-17955714-36ac-48ce-b3db-d05b8163f89f tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Returning 404 to user: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-17955714-36ac-48ce-b3db-d05b8163f89f tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88" status: 404 len: 109 microversion: 2.1 time: 0.046130 Jun 22 18:51:54.456293 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 657/1260] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:51:54 2022] GET /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:54.464241 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-00d9346a-8a0e-450a-85ab-3f265d505064 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd75566a310>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:54.497166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-00d9346a-8a0e-450a-85ab-3f265d505064 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] HTTP exception thrown: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-00d9346a-8a0e-450a-85ab-3f265d505064 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Request method failure captured: Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: DELETE /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88 HTTP/1.1 Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2S-x52PathnwiwFP6URa3d1VRD0b_EV1pdZ6JGqLkGVmxxF0zsu6Yh66xXMcTOkOYUhiG7vAX9BUFrTvnCdVHbUWhPLV1KHbvsaj23_UUXVPAUUiFur8JStiPfsl7qCTiHBUJfPGhTg6kTDAEKBuVY5MdrRS-3-GVq17r97C38yEl4 Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 4549b943b3ae4304ace38051cc0e4ef0 Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-605574526 Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:51:54.499274 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:51:54.500979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4549b943b3ae4304ace38051cc0e4ef0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4549b943b3ae4304ace38051cc0e4ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4549b943b3ae4304ace38051cc0e4ef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4549b943b3ae4304ace38051cc0e4ef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:51:54.500979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-VolumesSnapshotsTestJSON-605574526 Jun 22 18:51:54.500979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 4549b943b3ae4304ace38051cc0e4ef0 Jun 22 18:51:54.500979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-605574526 Jun 22 18:51:54.500979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-VolumesSnapshotsTestJSON-605574526-project Jun 22 18:51:54.500979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:51:54.500979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:51:54.500979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: 17f890210c4c48f7a5edddd27ad9135d Jun 22 18:51:54.500979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-VolumesSnapshotsTestJSON-605574526-project Jun 22 18:51:54.500979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: Jun 22 18:51:54.500979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.500979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': '729632b8-e445-443f-8ebf-834bc4cd5d88'} Jun 22 18:51:54.500979 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. (HTTP 404) (Request-ID: req-d67935d2-9879-4136-b87a-0e3bcd0c0cf4) Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:54.502003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 18:51:54.503626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 18:51:54.505070 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-00d9346a-8a0e-450a-85ab-3f265d505064 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Returning 404 to user: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-00d9346a-8a0e-450a-85ab-3f265d505064 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88" status: 404 len: 109 microversion: 2.1 time: 0.040590 Jun 22 18:51:54.507627 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 604/1261] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 22 18:51:54 2022] DELETE /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:54.509939 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-46f57b5a-652a-4e09-8c98-b4d53baff4a5 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Calling method '.version_select at 0x7fd75548b8b0>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:54.539780 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-46f57b5a-652a-4e09-8c98-b4d53baff4a5 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] HTTP exception thrown: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-46f57b5a-652a-4e09-8c98-b4d53baff4a5 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Request method failure captured: Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88 HTTP/1.1 Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2S-x52PathnwiwFP6URa3d1VRD0b_EV1pdZ6JGqLkGVmxxF0zsu6Yh66xXMcTOkOYUhiG7vAX9BUFrTvnCdVHbUWhPLV1KHbvsaj23_UUXVPAUUiFur8JStiPfsl7qCTiHBUJfPGhTg6kTDAEKBuVY5MdrRS-3-GVq17r97C38yEl4 Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 4549b943b3ae4304ace38051cc0e4ef0 Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-605574526 Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:51:54.541725 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:51:54.543356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4549b943b3ae4304ace38051cc0e4ef0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4549b943b3ae4304ace38051cc0e4ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4549b943b3ae4304ace38051cc0e4ef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4549b943b3ae4304ace38051cc0e4ef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:51:54.543356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-VolumesSnapshotsTestJSON-605574526 Jun 22 18:51:54.543356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 4549b943b3ae4304ace38051cc0e4ef0 Jun 22 18:51:54.543356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-605574526 Jun 22 18:51:54.543356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-VolumesSnapshotsTestJSON-605574526-project Jun 22 18:51:54.543356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:51:54.543356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:51:54.543356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 17f890210c4c48f7a5edddd27ad9135d Jun 22 18:51:54.543356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-VolumesSnapshotsTestJSON-605574526-project Jun 22 18:51:54.543356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: Jun 22 18:51:54.543356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.543356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '729632b8-e445-443f-8ebf-834bc4cd5d88'} Jun 22 18:51:54.543356 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. (HTTP 404) (Request-ID: req-03b2876d-c55e-47ed-954a-403721cd8a6f) Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:54.544419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 18:51:54.545868 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 18:51:54.547231 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-46f57b5a-652a-4e09-8c98-b4d53baff4a5 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] Returning 404 to user: Volume 729632b8-e445-443f-8ebf-834bc4cd5d88 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-46f57b5a-652a-4e09-8c98-b4d53baff4a5 tempest-VolumesSnapshotsTestJSON-605574526 tempest-VolumesSnapshotsTestJSON-605574526-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88" status: 404 len: 109 microversion: 2.1 time: 0.037850 Jun 22 18:51:54.548919 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 658/1262] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 22 18:51:54 2022] GET /compute/v2.1/os-volumes/729632b8-e445-443f-8ebf-834bc4cd5d88 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:51:55.017488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-28c02c91-aeff-43b3-8c94-8ac710ebb0c3 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:55.018171 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-28c02c91-aeff-43b3-8c94-8ac710ebb0c3 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:55.025342 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-28c02c91-aeff-43b3-8c94-8ac710ebb0c3 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:55.025791 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-28c02c91-aeff-43b3-8c94-8ac710ebb0c3 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:55.026750 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-28c02c91-aeff-43b3-8c94-8ac710ebb0c3 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:55.027178 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-28c02c91-aeff-43b3-8c94-8ac710ebb0c3 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:55.177815 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-28c02c91-aeff-43b3-8c94-8ac710ebb0c3 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:55.187135 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-28c02c91-aeff-43b3-8c94-8ac710ebb0c3 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.173644 Jun 22 18:51:55.187471 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 605/1263] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:55 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:56.202227 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=35 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:51:56.206639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e201b1a5-1290-4107-94e1-32ca9c4def75 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:56.207256 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e201b1a5-1290-4107-94e1-32ca9c4def75 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:56.213673 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e201b1a5-1290-4107-94e1-32ca9c4def75 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:56.214117 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e201b1a5-1290-4107-94e1-32ca9c4def75 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:56.214995 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e201b1a5-1290-4107-94e1-32ca9c4def75 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:56.215315 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e201b1a5-1290-4107-94e1-32ca9c4def75 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:56.349650 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e201b1a5-1290-4107-94e1-32ca9c4def75 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:56.358254 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e201b1a5-1290-4107-94e1-32ca9c4def75 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.156635 Jun 22 18:51:56.358816 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 659/1264] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:56 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:57.356506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-c9aac4ec-fe88-4a22-8658-fa0fa72167e1 req-88b8f686-1424-4242-8e49-136e691c7264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86e86e1-908c-41fd-a29f-2c257cc62df3", "tag": "1c2aaafb-4ce0-4795-b06a-4cff3a62556e"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:51:57.366758 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-c9aac4ec-fe88-4a22-8658-fa0fa72167e1 req-88b8f686-1424-4242-8e49-136e691c7264 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:57.367490 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-c9aac4ec-fe88-4a22-8658-fa0fa72167e1 req-88b8f686-1424-4242-8e49-136e691c7264 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:57.374442 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-572ebe5e-41d4-40ba-9714-055c9b3a49f0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:57.375055 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-572ebe5e-41d4-40ba-9714-055c9b3a49f0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:57.382794 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-572ebe5e-41d4-40ba-9714-055c9b3a49f0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:57.383499 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-572ebe5e-41d4-40ba-9714-055c9b3a49f0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:57.385616 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-572ebe5e-41d4-40ba-9714-055c9b3a49f0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:57.386435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-572ebe5e-41d4-40ba-9714-055c9b3a49f0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:57.389506 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-c9aac4ec-fe88-4a22-8658-fa0fa72167e1 req-88b8f686-1424-4242-8e49-136e691c7264 service nova] Creating event network-changed:1c2aaafb-4ce0-4795-b06a-4cff3a62556e for instance f86e86e1-908c-41fd-a29f-2c257cc62df3 on hv-cinder-81268 Jun 22 18:51:57.399476 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-c9aac4ec-fe88-4a22-8658-fa0fa72167e1 req-88b8f686-1424-4242-8e49-136e691c7264 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046847 Jun 22 18:51:57.400113 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 606/1265] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:51:57.529021 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-572ebe5e-41d4-40ba-9714-055c9b3a49f0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:57.536546 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-572ebe5e-41d4-40ba-9714-055c9b3a49f0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.165869 Jun 22 18:51:57.537119 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 660/1266] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:57 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:51:58.555239 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-603b521c-ac04-46d0-b1ba-82c0d21d2735 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:58.555958 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-603b521c-ac04-46d0-b1ba-82c0d21d2735 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:58.562267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-603b521c-ac04-46d0-b1ba-82c0d21d2735 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:58.562719 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-603b521c-ac04-46d0-b1ba-82c0d21d2735 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:58.563488 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-603b521c-ac04-46d0-b1ba-82c0d21d2735 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:58.563964 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-603b521c-ac04-46d0-b1ba-82c0d21d2735 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:58.699148 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-603b521c-ac04-46d0-b1ba-82c0d21d2735 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:58.706589 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-603b521c-ac04-46d0-b1ba-82c0d21d2735 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.156902 Jun 22 18:51:58.707159 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 607/1267] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:58 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:51:59.724013 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-21dcaaa9-b168-49f0-b9c4-50a815d5ad9f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:51:59.724616 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-21dcaaa9-b168-49f0-b9c4-50a815d5ad9f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:51:59.731175 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-21dcaaa9-b168-49f0-b9c4-50a815d5ad9f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:59.731621 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-21dcaaa9-b168-49f0-b9c4-50a815d5ad9f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:59.732414 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-21dcaaa9-b168-49f0-b9c4-50a815d5ad9f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:51:59.732848 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-21dcaaa9-b168-49f0-b9c4-50a815d5ad9f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:51:59.860043 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-21dcaaa9-b168-49f0-b9c4-50a815d5ad9f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:51:59.868606 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-21dcaaa9-b168-49f0-b9c4-50a815d5ad9f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.148474 Jun 22 18:51:59.869160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 661/1268] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:51:59 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:52:00.886392 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-450257ae-89c5-4436-931c-d6b1b747c17e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:52:00.886991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-450257ae-89c5-4436-931c-d6b1b747c17e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:52:00.893218 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-450257ae-89c5-4436-931c-d6b1b747c17e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:00.893955 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-450257ae-89c5-4436-931c-d6b1b747c17e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:00.894414 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-450257ae-89c5-4436-931c-d6b1b747c17e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:00.894871 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-450257ae-89c5-4436-931c-d6b1b747c17e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:01.021220 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-450257ae-89c5-4436-931c-d6b1b747c17e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:52:01.028838 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-450257ae-89c5-4436-931c-d6b1b747c17e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.147433 Jun 22 18:52:01.029341 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 608/1269] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:52:00 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:52:02.045839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-18350040-1506-41b2-9e23-2905e480fbb6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:52:02.046395 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-18350040-1506-41b2-9e23-2905e480fbb6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:52:02.052899 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-18350040-1506-41b2-9e23-2905e480fbb6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:02.053526 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-18350040-1506-41b2-9e23-2905e480fbb6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:02.054309 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-18350040-1506-41b2-9e23-2905e480fbb6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:02.054750 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-18350040-1506-41b2-9e23-2905e480fbb6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:02.182628 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-18350040-1506-41b2-9e23-2905e480fbb6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:52:02.190069 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-18350040-1506-41b2-9e23-2905e480fbb6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.148161 Jun 22 18:52:02.190626 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 662/1270] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:52:02 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:52:03.207006 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-13c9dbb3-c444-4cc1-be0b-ec613906aede tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:52:03.208350 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-13c9dbb3-c444-4cc1-be0b-ec613906aede tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:52:03.212515 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:03.216366 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-13c9dbb3-c444-4cc1-be0b-ec613906aede tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:03.216823 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-13c9dbb3-c444-4cc1-be0b-ec613906aede tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:03.217602 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-13c9dbb3-c444-4cc1-be0b-ec613906aede tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:03.218196 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-13c9dbb3-c444-4cc1-be0b-ec613906aede tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:03.431874 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-13c9dbb3-c444-4cc1-be0b-ec613906aede tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:52:03.439293 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-13c9dbb3-c444-4cc1-be0b-ec613906aede tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.236537 Jun 22 18:52:03.440093 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 609/1271] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:52:03 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:52:04.456898 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e7f2e369-6908-4ddf-af2c-f500125cfd6b tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:52:04.457500 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e7f2e369-6908-4ddf-af2c-f500125cfd6b tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:52:04.464647 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7f2e369-6908-4ddf-af2c-f500125cfd6b tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:04.465089 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7f2e369-6908-4ddf-af2c-f500125cfd6b tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:04.465847 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7f2e369-6908-4ddf-af2c-f500125cfd6b tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:04.466276 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e7f2e369-6908-4ddf-af2c-f500125cfd6b tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:04.594361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e7f2e369-6908-4ddf-af2c-f500125cfd6b tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:52:04.604874 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e7f2e369-6908-4ddf-af2c-f500125cfd6b tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.151654 Jun 22 18:52:04.605785 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 663/1272] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:52:04 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:52:04.608557 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-a61ef3e2-52d1-4c10-8221-1f435682c96a req-1ad0b0c3-4d37-4ae9-bbb3-c4410f7d8514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86e86e1-908c-41fd-a29f-2c257cc62df3", "name": "network-vif-plugged", "status": "completed", "tag": "1c2aaafb-4ce0-4795-b06a-4cff3a62556e"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:52:04.618247 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-a61ef3e2-52d1-4c10-8221-1f435682c96a req-1ad0b0c3-4d37-4ae9-bbb3-c4410f7d8514 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:04.618826 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-a61ef3e2-52d1-4c10-8221-1f435682c96a req-1ad0b0c3-4d37-4ae9-bbb3-c4410f7d8514 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:04.623100 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=86 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:04.632385 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-a61ef3e2-52d1-4c10-8221-1f435682c96a req-1ad0b0c3-4d37-4ae9-bbb3-c4410f7d8514 service nova] Creating event network-vif-plugged:1c2aaafb-4ce0-4795-b06a-4cff3a62556e for instance f86e86e1-908c-41fd-a29f-2c257cc62df3 on hv-cinder-81268 Jun 22 18:52:04.637446 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-a61ef3e2-52d1-4c10-8221-1f435682c96a req-1ad0b0c3-4d37-4ae9-bbb3-c4410f7d8514 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033928 Jun 22 18:52:04.638029 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 610/1273] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:52:05.622375 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-6dd8ef7a-1768-4531-bfbd-6158e077a582 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:52:05.622947 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-6dd8ef7a-1768-4531-bfbd-6158e077a582 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:52:05.629679 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6dd8ef7a-1768-4531-bfbd-6158e077a582 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:05.630125 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6dd8ef7a-1768-4531-bfbd-6158e077a582 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:05.630885 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6dd8ef7a-1768-4531-bfbd-6158e077a582 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:05.631759 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-6dd8ef7a-1768-4531-bfbd-6158e077a582 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:05.768616 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-6dd8ef7a-1768-4531-bfbd-6158e077a582 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:52:05.776607 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-6dd8ef7a-1768-4531-bfbd-6158e077a582 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1358 microversion: 2.1 time: 0.158149 Jun 22 18:52:05.777171 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 664/1274] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:52:05 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:52:06.794398 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-d90b2f46-c253-4bb6-8196-2cce966ea8bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:52:06.795095 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-d90b2f46-c253-4bb6-8196-2cce966ea8bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:52:06.801668 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d90b2f46-c253-4bb6-8196-2cce966ea8bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:06.802122 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d90b2f46-c253-4bb6-8196-2cce966ea8bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:06.802924 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d90b2f46-c253-4bb6-8196-2cce966ea8bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:06.804207 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-d90b2f46-c253-4bb6-8196-2cce966ea8bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:07.288894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-d90b2f46-c253-4bb6-8196-2cce966ea8bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:52:07.296598 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-d90b2f46-c253-4bb6-8196-2cce966ea8bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1548 microversion: 2.1 time: 0.506801 Jun 22 18:52:07.297168 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 611/1275] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:52:06 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1548 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:52:07.315268 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-d7ecb548-138c-4bdd-b33a-674c2b1d9466 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:52:07.317330 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-d7ecb548-138c-4bdd-b33a-674c2b1d9466 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:52:07.323697 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d7ecb548-138c-4bdd-b33a-674c2b1d9466 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:07.324193 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d7ecb548-138c-4bdd-b33a-674c2b1d9466 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:07.324957 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d7ecb548-138c-4bdd-b33a-674c2b1d9466 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:07.325412 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-d7ecb548-138c-4bdd-b33a-674c2b1d9466 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:07.460306 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-d7ecb548-138c-4bdd-b33a-674c2b1d9466 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:52:07.467760 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-d7ecb548-138c-4bdd-b33a-674c2b1d9466 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1548 microversion: 2.1 time: 0.156482 Jun 22 18:52:07.468347 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 665/1276] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:52:07 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:52:07.484660 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c76ea7f9-de05-49e2-bdd1-78aed0604a32 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:52:07.488331 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c76ea7f9-de05-49e2-bdd1-78aed0604a32 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:52:07.489092 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c76ea7f9-de05-49e2-bdd1-78aed0604a32 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Searching by: {'deleted': False, 'project_id': '6be45c6791274b4c9f58753498a1684d'} {{(pid=129743) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 22 18:52:07.496460 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c76ea7f9-de05-49e2-bdd1-78aed0604a32 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:07.497118 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c76ea7f9-de05-49e2-bdd1-78aed0604a32 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:07.498092 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c76ea7f9-de05-49e2-bdd1-78aed0604a32 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:07.498752 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c76ea7f9-de05-49e2-bdd1-78aed0604a32 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:07.592002 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.multi_cell_list [None req-c76ea7f9-de05-49e2-bdd1-78aed0604a32 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129743) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 22 18:52:07.725716 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c76ea7f9-de05-49e2-bdd1-78aed0604a32 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.244280 Jun 22 18:52:07.726249 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 612/1277] 10.222.0.18 () {58 vars in 1124 bytes} [Wed Jun 22 18:52:07 2022] GET /compute/v2.1/servers => generated 343 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:52:07.736608 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7ec6eb08-39eb-4e1e-84b8-4734cf1596bf tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:52:07.737221 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7ec6eb08-39eb-4e1e-84b8-4734cf1596bf tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:52:07.744117 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ec6eb08-39eb-4e1e-84b8-4734cf1596bf tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:07.744577 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ec6eb08-39eb-4e1e-84b8-4734cf1596bf tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:07.745355 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ec6eb08-39eb-4e1e-84b8-4734cf1596bf tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:07.745799 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ec6eb08-39eb-4e1e-84b8-4734cf1596bf tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:07.882980 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7ec6eb08-39eb-4e1e-84b8-4734cf1596bf tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:52:07.891665 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7ec6eb08-39eb-4e1e-84b8-4734cf1596bf tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1548 microversion: 2.1 time: 0.158795 Jun 22 18:52:07.892310 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 666/1278] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:52:07 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:52:09.452294 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a57707ce-e935-483c-96d0-ef6003019d4f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8a65262-9160-4a88-bf5d-2aa7392c8839"}} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:52:09.453370 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a57707ce-e935-483c-96d0-ef6003019d4f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:52:09.460332 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a57707ce-e935-483c-96d0-ef6003019d4f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:09.460791 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a57707ce-e935-483c-96d0-ef6003019d4f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:09.461558 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a57707ce-e935-483c-96d0-ef6003019d4f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:09.461992 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a57707ce-e935-483c-96d0-ef6003019d4f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:09.712762 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a57707ce-e935-483c-96d0-ef6003019d4f tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "POST /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264243 Jun 22 18:52:09.713724 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 613/1279] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 22 18:52:09 2022] POST /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:52:17.281558 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-ed821a29-e387-465d-84d8-b8f1a795bc79 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:52:17.282157 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-ed821a29-e387-465d-84d8-b8f1a795bc79 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:52:17.289304 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ed821a29-e387-465d-84d8-b8f1a795bc79 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:17.289727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ed821a29-e387-465d-84d8-b8f1a795bc79 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:17.290478 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ed821a29-e387-465d-84d8-b8f1a795bc79 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:17.290903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-ed821a29-e387-465d-84d8-b8f1a795bc79 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:17.432879 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-ed821a29-e387-465d-84d8-b8f1a795bc79 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:52:17.443414 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-ed821a29-e387-465d-84d8-b8f1a795bc79 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1594 microversion: 2.1 time: 0.165569 Jun 22 18:52:17.444010 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 667/1280] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:52:17 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1594 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:52:19.205956 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell0:SELECT=2 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:52:19.210527 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-a2ff5a29-f2d7-4470-a803-2afc9c72c610 req-a429d289-7640-4a71-9615-06c7565b3e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86e86e1-908c-41fd-a29f-2c257cc62df3", "tag": "1c2aaafb-4ce0-4795-b06a-4cff3a62556e"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:52:19.219785 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-a2ff5a29-f2d7-4470-a803-2afc9c72c610 req-a429d289-7640-4a71-9615-06c7565b3e84 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:19.220489 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-a2ff5a29-f2d7-4470-a803-2afc9c72c610 req-a429d289-7640-4a71-9615-06c7565b3e84 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:19.232108 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-a2ff5a29-f2d7-4470-a803-2afc9c72c610 req-a429d289-7640-4a71-9615-06c7565b3e84 service nova] Creating event network-changed:1c2aaafb-4ce0-4795-b06a-4cff3a62556e for instance f86e86e1-908c-41fd-a29f-2c257cc62df3 on hv-cinder-81268 Jun 22 18:52:19.237397 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-a2ff5a29-f2d7-4470-a803-2afc9c72c610 req-a429d289-7640-4a71-9615-06c7565b3e84 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032827 Jun 22 18:52:19.238091 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 614/1281] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:52:20.556292 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4a73066b-217b-4749-a901-3c186c4ed0a0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-319233564"}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:52:20.556824 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4a73066b-217b-4749-a901-3c186c4ed0a0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:52:20.563014 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a73066b-217b-4749-a901-3c186c4ed0a0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:20.563452 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a73066b-217b-4749-a901-3c186c4ed0a0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:20.564575 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a73066b-217b-4749-a901-3c186c4ed0a0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:20.565008 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a73066b-217b-4749-a901-3c186c4ed0a0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:20.698268 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.network.security_group_api [None req-4a73066b-217b-4749-a901-3c186c4ed0a0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Adding security group 508a1aa8-2027-4d97-8c78-4a87ad8066df to port 1c2aaafb-4ce0-4795-b06a-4cff3a62556e Jun 22 18:52:21.209700 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4a73066b-217b-4749-a901-3c186c4ed0a0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "POST /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/action" status: 202 len: 0 microversion: 2.1 time: 0.657590 Jun 22 18:52:21.210460 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 668/1282] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:52:20 2022] POST /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:52:21.224601 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-61ea40fa-a886-4c76-a3a3-90fdd1ad4e09 req-5cc14304-2122-45db-9239-37c87f151777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86e86e1-908c-41fd-a29f-2c257cc62df3", "tag": "1c2aaafb-4ce0-4795-b06a-4cff3a62556e"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:52:21.235348 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-61ea40fa-a886-4c76-a3a3-90fdd1ad4e09 req-5cc14304-2122-45db-9239-37c87f151777 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:21.235604 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-82667a37-2b63-4074-b747-edac1991357c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:52:21.236599 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-82667a37-2b63-4074-b747-edac1991357c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:52:21.236806 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-61ea40fa-a886-4c76-a3a3-90fdd1ad4e09 req-5cc14304-2122-45db-9239-37c87f151777 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:21.255964 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-82667a37-2b63-4074-b747-edac1991357c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:21.256883 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-61ea40fa-a886-4c76-a3a3-90fdd1ad4e09 req-5cc14304-2122-45db-9239-37c87f151777 service nova] Creating event network-changed:1c2aaafb-4ce0-4795-b06a-4cff3a62556e for instance f86e86e1-908c-41fd-a29f-2c257cc62df3 on hv-cinder-81268 Jun 22 18:52:21.257524 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-82667a37-2b63-4074-b747-edac1991357c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:21.258487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-82667a37-2b63-4074-b747-edac1991357c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:52:21.259131 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-82667a37-2b63-4074-b747-edac1991357c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:52:21.268389 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-61ea40fa-a886-4c76-a3a3-90fdd1ad4e09 req-5cc14304-2122-45db-9239-37c87f151777 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047442 Jun 22 18:52:21.271221 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 669/1283] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:52:21.555664 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-82667a37-2b63-4074-b747-edac1991357c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:52:21.567241 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-82667a37-2b63-4074-b747-edac1991357c tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1757 microversion: 2.1 time: 0.351023 Jun 22 18:52:21.567861 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 615/1284] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:52:21 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1757 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:22.061567 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=22 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:53:22.062216 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=60 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:53:22.067033 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-4a847fe7-d35d-481b-a415-176a0f4b5030 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:53:22.068098 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-4a847fe7-d35d-481b-a415-176a0f4b5030 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:22.075563 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a847fe7-d35d-481b-a415-176a0f4b5030 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:22.076040 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a847fe7-d35d-481b-a415-176a0f4b5030 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:22.076800 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a847fe7-d35d-481b-a415-176a0f4b5030 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:22.077229 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-4a847fe7-d35d-481b-a415-176a0f4b5030 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:22.151269 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-4a847fe7-d35d-481b-a415-176a0f4b5030 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "POST /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/action" status: 202 len: 0 microversion: 2.1 time: 0.091525 Jun 22 18:53:22.152547 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 670/1285] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:53:22 2022] POST /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:53:22.159349 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=13 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:53:22.160243 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:53:22.164953 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b6fb0f42-2965-4f50-8ec8-f73923b0b963 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:22.165559 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b6fb0f42-2965-4f50-8ec8-f73923b0b963 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:22.174894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b6fb0f42-2965-4f50-8ec8-f73923b0b963 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:22.175338 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b6fb0f42-2965-4f50-8ec8-f73923b0b963 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:22.176129 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b6fb0f42-2965-4f50-8ec8-f73923b0b963 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:22.176560 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b6fb0f42-2965-4f50-8ec8-f73923b0b963 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:22.694618 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b6fb0f42-2965-4f50-8ec8-f73923b0b963 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:22.703461 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b6fb0f42-2965-4f50-8ec8-f73923b0b963 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1749 microversion: 2.1 time: 0.546041 Jun 22 18:53:22.704082 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 616/1286] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:22 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1749 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:23.721821 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-fc4b80c1-8eb4-47e2-a9f4-b96747ef889e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:23.722439 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-fc4b80c1-8eb4-47e2-a9f4-b96747ef889e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:23.729497 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fc4b80c1-8eb4-47e2-a9f4-b96747ef889e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:23.729949 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fc4b80c1-8eb4-47e2-a9f4-b96747ef889e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:23.730710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fc4b80c1-8eb4-47e2-a9f4-b96747ef889e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:23.731144 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-fc4b80c1-8eb4-47e2-a9f4-b96747ef889e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:23.928674 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-fc4b80c1-8eb4-47e2-a9f4-b96747ef889e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:23.937080 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-fc4b80c1-8eb4-47e2-a9f4-b96747ef889e tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1754 microversion: 2.1 time: 0.219621 Jun 22 18:53:23.937630 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 671/1287] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:23 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1754 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:24.954868 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2b692322-cc09-4018-ba9d-a6b0baf3f807 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:24.955477 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2b692322-cc09-4018-ba9d-a6b0baf3f807 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:24.962487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2b692322-cc09-4018-ba9d-a6b0baf3f807 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:24.962959 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2b692322-cc09-4018-ba9d-a6b0baf3f807 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:24.963725 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2b692322-cc09-4018-ba9d-a6b0baf3f807 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:24.964189 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2b692322-cc09-4018-ba9d-a6b0baf3f807 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:25.101500 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-2b692322-cc09-4018-ba9d-a6b0baf3f807 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:25.110015 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2b692322-cc09-4018-ba9d-a6b0baf3f807 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1754 microversion: 2.1 time: 0.159035 Jun 22 18:53:25.110577 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 617/1288] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:24 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:26.126602 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f67bf65f-2692-42f0-b443-26a7968362b1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:26.127230 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f67bf65f-2692-42f0-b443-26a7968362b1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:26.134634 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f67bf65f-2692-42f0-b443-26a7968362b1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:26.135075 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f67bf65f-2692-42f0-b443-26a7968362b1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:26.135859 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f67bf65f-2692-42f0-b443-26a7968362b1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:26.136286 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f67bf65f-2692-42f0-b443-26a7968362b1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:26.276635 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f67bf65f-2692-42f0-b443-26a7968362b1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:26.284916 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f67bf65f-2692-42f0-b443-26a7968362b1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1754 microversion: 2.1 time: 0.162172 Jun 22 18:53:26.285679 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 672/1289] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:26 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:27.303019 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-cd48ee7c-437f-4637-85d3-9955ac54d360 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:27.303710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-cd48ee7c-437f-4637-85d3-9955ac54d360 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:27.310752 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cd48ee7c-437f-4637-85d3-9955ac54d360 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:27.311199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cd48ee7c-437f-4637-85d3-9955ac54d360 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:27.311980 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cd48ee7c-437f-4637-85d3-9955ac54d360 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:27.312413 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-cd48ee7c-437f-4637-85d3-9955ac54d360 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:27.457315 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-cd48ee7c-437f-4637-85d3-9955ac54d360 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:27.465216 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-cd48ee7c-437f-4637-85d3-9955ac54d360 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1754 microversion: 2.1 time: 0.166128 Jun 22 18:53:27.465783 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 618/1290] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:27 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:28.483518 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-dff6c72f-998c-4caa-a3a6-f35e1c52ea17 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:28.484145 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-dff6c72f-998c-4caa-a3a6-f35e1c52ea17 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:28.490640 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dff6c72f-998c-4caa-a3a6-f35e1c52ea17 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:28.491086 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dff6c72f-998c-4caa-a3a6-f35e1c52ea17 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:28.491871 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dff6c72f-998c-4caa-a3a6-f35e1c52ea17 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:28.492308 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-dff6c72f-998c-4caa-a3a6-f35e1c52ea17 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:28.635234 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-dff6c72f-998c-4caa-a3a6-f35e1c52ea17 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:28.643929 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-dff6c72f-998c-4caa-a3a6-f35e1c52ea17 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1754 microversion: 2.1 time: 0.164064 Jun 22 18:53:28.644418 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 673/1291] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:28 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:29.661792 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-78a895df-b439-4aaa-8f55-d552f30e6c43 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:29.662321 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-78a895df-b439-4aaa-8f55-d552f30e6c43 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:29.669431 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-78a895df-b439-4aaa-8f55-d552f30e6c43 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:29.670219 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-78a895df-b439-4aaa-8f55-d552f30e6c43 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:29.671077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-78a895df-b439-4aaa-8f55-d552f30e6c43 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:29.671511 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-78a895df-b439-4aaa-8f55-d552f30e6c43 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:29.818184 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-78a895df-b439-4aaa-8f55-d552f30e6c43 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:29.826403 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-78a895df-b439-4aaa-8f55-d552f30e6c43 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1754 microversion: 2.1 time: 0.168732 Jun 22 18:53:29.826976 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 619/1292] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:29 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:30.843748 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e8d1f5b2-63d0-4541-abd0-118c8fcdea51 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:30.844386 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e8d1f5b2-63d0-4541-abd0-118c8fcdea51 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:30.850908 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e8d1f5b2-63d0-4541-abd0-118c8fcdea51 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:30.851351 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e8d1f5b2-63d0-4541-abd0-118c8fcdea51 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:30.852613 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e8d1f5b2-63d0-4541-abd0-118c8fcdea51 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:30.853054 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e8d1f5b2-63d0-4541-abd0-118c8fcdea51 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:30.993181 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-e8d1f5b2-63d0-4541-abd0-118c8fcdea51 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:31.002302 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e8d1f5b2-63d0-4541-abd0-118c8fcdea51 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1754 microversion: 2.1 time: 0.162398 Jun 22 18:53:31.002862 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 674/1293] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:30 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:32.020217 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c9ec7f75-8faa-41fe-9bf7-5bbe512e44d0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:32.020804 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c9ec7f75-8faa-41fe-9bf7-5bbe512e44d0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:32.027519 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c9ec7f75-8faa-41fe-9bf7-5bbe512e44d0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:32.027947 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c9ec7f75-8faa-41fe-9bf7-5bbe512e44d0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:32.028707 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c9ec7f75-8faa-41fe-9bf7-5bbe512e44d0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:32.029164 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c9ec7f75-8faa-41fe-9bf7-5bbe512e44d0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:32.176002 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c9ec7f75-8faa-41fe-9bf7-5bbe512e44d0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:32.184726 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c9ec7f75-8faa-41fe-9bf7-5bbe512e44d0 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1754 microversion: 2.1 time: 0.168348 Jun 22 18:53:32.185286 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 620/1294] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:32 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:33.202083 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f376ce88-796c-4b66-b8c4-ad4c8033e944 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:33.202660 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f376ce88-796c-4b66-b8c4-ad4c8033e944 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:33.209213 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f376ce88-796c-4b66-b8c4-ad4c8033e944 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:33.209655 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f376ce88-796c-4b66-b8c4-ad4c8033e944 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:33.210402 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f376ce88-796c-4b66-b8c4-ad4c8033e944 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:33.210827 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f376ce88-796c-4b66-b8c4-ad4c8033e944 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:33.347163 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f376ce88-796c-4b66-b8c4-ad4c8033e944 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:33.355247 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f376ce88-796c-4b66-b8c4-ad4c8033e944 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1754 microversion: 2.1 time: 0.157119 Jun 22 18:53:33.355801 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 675/1295] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:33 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:34.372444 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b1053671-ca52-481a-9e07-04cf9b4194b4 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:34.373036 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b1053671-ca52-481a-9e07-04cf9b4194b4 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:34.379436 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b1053671-ca52-481a-9e07-04cf9b4194b4 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:34.379907 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b1053671-ca52-481a-9e07-04cf9b4194b4 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:34.380669 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b1053671-ca52-481a-9e07-04cf9b4194b4 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:34.381098 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b1053671-ca52-481a-9e07-04cf9b4194b4 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:34.524199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b1053671-ca52-481a-9e07-04cf9b4194b4 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:34.532926 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b1053671-ca52-481a-9e07-04cf9b4194b4 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1757 microversion: 2.1 time: 0.164756 Jun 22 18:53:34.533530 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 621/1296] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:34 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:55.764542 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-8b7e4e12-2ec3-4a47-a418-7c67494093da tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:53:55.765128 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-8b7e4e12-2ec3-4a47-a418-7c67494093da tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:55.767182 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=12 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:53:55.767851 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:53:55.774257 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8b7e4e12-2ec3-4a47-a418-7c67494093da tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:55.774701 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8b7e4e12-2ec3-4a47-a418-7c67494093da tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:55.775472 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8b7e4e12-2ec3-4a47-a418-7c67494093da tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:55.775944 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-8b7e4e12-2ec3-4a47-a418-7c67494093da tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:55.801100 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-8b7e4e12-2ec3-4a47-a418-7c67494093da tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lazy-loading 'flavor' on Instance uuid 7b1480f2-347e-427e-973a-273c41839863 {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:53:55.877740 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-8b7e4e12-2ec3-4a47-a418-7c67494093da tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863/action" status: 202 len: 0 microversion: 2.1 time: 0.116974 Jun 22 18:53:55.878420 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 676/1297] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:53:55 2022] POST /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:53:55.886391 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 18:53:55.886633 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Wed Jun 22 18:53:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 18:53:55.889009 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-75d3b00b-3fc6-4d21-b194-087eb16b9721 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:55.890235 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-75d3b00b-3fc6-4d21-b194-087eb16b9721 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:55.896894 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=12 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:53:55.897630 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=36 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:53:55.899156 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75d3b00b-3fc6-4d21-b194-087eb16b9721 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:55.899604 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75d3b00b-3fc6-4d21-b194-087eb16b9721 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:55.900565 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75d3b00b-3fc6-4d21-b194-087eb16b9721 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:55.900985 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-75d3b00b-3fc6-4d21-b194-087eb16b9721 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:56.043092 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-75d3b00b-3fc6-4d21-b194-087eb16b9721 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:56.051466 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-75d3b00b-3fc6-4d21-b194-087eb16b9721 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.168522 Jun 22 18:53:56.052075 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 622/1298] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:55 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:53:57.070710 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-1f6a0d68-350d-4660-a9a8-e0f157fdd4ca tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:57.071937 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-1f6a0d68-350d-4660-a9a8-e0f157fdd4ca tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:57.078189 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1f6a0d68-350d-4660-a9a8-e0f157fdd4ca tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:57.078638 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1f6a0d68-350d-4660-a9a8-e0f157fdd4ca tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:57.079397 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1f6a0d68-350d-4660-a9a8-e0f157fdd4ca tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:57.079841 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-1f6a0d68-350d-4660-a9a8-e0f157fdd4ca tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:57.213560 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-1f6a0d68-350d-4660-a9a8-e0f157fdd4ca tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:57.221187 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-1f6a0d68-350d-4660-a9a8-e0f157fdd4ca tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.155769 Jun 22 18:53:57.221743 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 677/1299] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:57 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:58.238014 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bd8b89d0-dc5c-459b-bd8b-959836e6122f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:58.238619 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bd8b89d0-dc5c-459b-bd8b-959836e6122f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:58.245312 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bd8b89d0-dc5c-459b-bd8b-959836e6122f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:58.245738 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bd8b89d0-dc5c-459b-bd8b-959836e6122f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:58.246513 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bd8b89d0-dc5c-459b-bd8b-959836e6122f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:58.246942 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bd8b89d0-dc5c-459b-bd8b-959836e6122f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:58.377415 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bd8b89d0-dc5c-459b-bd8b-959836e6122f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:58.385957 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bd8b89d0-dc5c-459b-bd8b-959836e6122f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.151718 Jun 22 18:53:58.386532 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 623/1300] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:58 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:53:59.404567 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7dcc498d-8d65-49df-912e-eaa8e263a273 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:53:59.405200 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7dcc498d-8d65-49df-912e-eaa8e263a273 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:53:59.411554 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7dcc498d-8d65-49df-912e-eaa8e263a273 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:59.412029 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7dcc498d-8d65-49df-912e-eaa8e263a273 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:59.412781 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7dcc498d-8d65-49df-912e-eaa8e263a273 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:53:59.413209 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7dcc498d-8d65-49df-912e-eaa8e263a273 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:53:59.544817 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7dcc498d-8d65-49df-912e-eaa8e263a273 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:53:59.552278 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7dcc498d-8d65-49df-912e-eaa8e263a273 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.151536 Jun 22 18:53:59.552827 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 678/1301] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:53:59 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:00.571145 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7ba43aa8-1fff-4d5c-90eb-d15565132fdd tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:00.571750 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7ba43aa8-1fff-4d5c-90eb-d15565132fdd tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:00.577842 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ba43aa8-1fff-4d5c-90eb-d15565132fdd tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:00.578284 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ba43aa8-1fff-4d5c-90eb-d15565132fdd tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:00.579034 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ba43aa8-1fff-4d5c-90eb-d15565132fdd tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:00.579459 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7ba43aa8-1fff-4d5c-90eb-d15565132fdd tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:00.712086 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-7ba43aa8-1fff-4d5c-90eb-d15565132fdd tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:00.719361 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7ba43aa8-1fff-4d5c-90eb-d15565132fdd tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.153342 Jun 22 18:54:00.719938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 624/1302] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:00 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:01.736423 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-5dae6e7b-f4ac-4b90-8ca4-d8acef7f3330 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:01.736972 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-5dae6e7b-f4ac-4b90-8ca4-d8acef7f3330 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:01.743413 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5dae6e7b-f4ac-4b90-8ca4-d8acef7f3330 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:01.743891 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5dae6e7b-f4ac-4b90-8ca4-d8acef7f3330 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:01.744656 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5dae6e7b-f4ac-4b90-8ca4-d8acef7f3330 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:01.745083 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-5dae6e7b-f4ac-4b90-8ca4-d8acef7f3330 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:01.875361 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-5dae6e7b-f4ac-4b90-8ca4-d8acef7f3330 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:01.883416 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-5dae6e7b-f4ac-4b90-8ca4-d8acef7f3330 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.150450 Jun 22 18:54:01.883998 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 679/1303] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:01 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:02.903433 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6899213f-2249-4d91-ab6a-33999857ac14 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:02.904147 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6899213f-2249-4d91-ab6a-33999857ac14 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:02.912178 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6899213f-2249-4d91-ab6a-33999857ac14 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:02.912917 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6899213f-2249-4d91-ab6a-33999857ac14 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:02.913698 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6899213f-2249-4d91-ab6a-33999857ac14 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:02.914136 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6899213f-2249-4d91-ab6a-33999857ac14 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:03.052719 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-6899213f-2249-4d91-ab6a-33999857ac14 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:03.060166 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6899213f-2249-4d91-ab6a-33999857ac14 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.163576 Jun 22 18:54:03.060763 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 625/1304] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:02 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:04.077071 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-11bc3624-019c-4d68-8fdb-ffe51a362dcb tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:04.077685 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-11bc3624-019c-4d68-8fdb-ffe51a362dcb tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:04.084233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-11bc3624-019c-4d68-8fdb-ffe51a362dcb tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:04.084678 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-11bc3624-019c-4d68-8fdb-ffe51a362dcb tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:04.085439 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-11bc3624-019c-4d68-8fdb-ffe51a362dcb tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:04.086450 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-11bc3624-019c-4d68-8fdb-ffe51a362dcb tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:04.215934 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-11bc3624-019c-4d68-8fdb-ffe51a362dcb tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:04.223374 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-11bc3624-019c-4d68-8fdb-ffe51a362dcb tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.150276 Jun 22 18:54:04.224860 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 680/1305] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:04 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:05.241618 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-bd4e78a2-dd4d-4306-82e7-ec0b94e39cf6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:05.242193 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-bd4e78a2-dd4d-4306-82e7-ec0b94e39cf6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:05.249452 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bd4e78a2-dd4d-4306-82e7-ec0b94e39cf6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:05.249902 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bd4e78a2-dd4d-4306-82e7-ec0b94e39cf6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:05.250721 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bd4e78a2-dd4d-4306-82e7-ec0b94e39cf6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:05.251157 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-bd4e78a2-dd4d-4306-82e7-ec0b94e39cf6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:05.377737 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-bd4e78a2-dd4d-4306-82e7-ec0b94e39cf6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:05.385596 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-bd4e78a2-dd4d-4306-82e7-ec0b94e39cf6 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.147935 Jun 22 18:54:05.386170 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 626/1306] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:05 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:06.402171 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-2c7256a2-7c3c-4dfc-b3a5-c5e57ed56c41 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:06.402774 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-2c7256a2-7c3c-4dfc-b3a5-c5e57ed56c41 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:06.409381 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2c7256a2-7c3c-4dfc-b3a5-c5e57ed56c41 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:06.409820 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2c7256a2-7c3c-4dfc-b3a5-c5e57ed56c41 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:06.410570 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2c7256a2-7c3c-4dfc-b3a5-c5e57ed56c41 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:06.410996 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-2c7256a2-7c3c-4dfc-b3a5-c5e57ed56c41 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:06.550668 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-2c7256a2-7c3c-4dfc-b3a5-c5e57ed56c41 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:06.558212 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-2c7256a2-7c3c-4dfc-b3a5-c5e57ed56c41 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.160542 Jun 22 18:54:06.558777 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 681/1307] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:06 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:07.577952 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-873e3d49-1de1-4289-b6e9-f37ffb629097 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:07.578560 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-873e3d49-1de1-4289-b6e9-f37ffb629097 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:07.585114 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-873e3d49-1de1-4289-b6e9-f37ffb629097 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:07.585560 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-873e3d49-1de1-4289-b6e9-f37ffb629097 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:07.586315 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-873e3d49-1de1-4289-b6e9-f37ffb629097 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:07.586757 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-873e3d49-1de1-4289-b6e9-f37ffb629097 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:07.718916 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-873e3d49-1de1-4289-b6e9-f37ffb629097 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:07.726369 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-873e3d49-1de1-4289-b6e9-f37ffb629097 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.152308 Jun 22 18:54:07.726929 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 627/1308] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:07 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:08.744203 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-9114fbea-24ae-41a0-964e-248d6f1acafc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:08.744819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-9114fbea-24ae-41a0-964e-248d6f1acafc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:08.753267 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9114fbea-24ae-41a0-964e-248d6f1acafc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:08.753723 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9114fbea-24ae-41a0-964e-248d6f1acafc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:08.754508 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9114fbea-24ae-41a0-964e-248d6f1acafc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:08.754944 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-9114fbea-24ae-41a0-964e-248d6f1acafc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:08.893658 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-9114fbea-24ae-41a0-964e-248d6f1acafc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:08.901561 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-9114fbea-24ae-41a0-964e-248d6f1acafc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.161390 Jun 22 18:54:08.902125 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 682/1309] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:08 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:09.917679 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-b4649517-9859-4bd7-9fb9-c23dd4ee1e95 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:09.918446 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-b4649517-9859-4bd7-9fb9-c23dd4ee1e95 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:09.924606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b4649517-9859-4bd7-9fb9-c23dd4ee1e95 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:09.925046 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b4649517-9859-4bd7-9fb9-c23dd4ee1e95 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:09.925840 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b4649517-9859-4bd7-9fb9-c23dd4ee1e95 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:09.926266 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-b4649517-9859-4bd7-9fb9-c23dd4ee1e95 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:10.071784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-b4649517-9859-4bd7-9fb9-c23dd4ee1e95 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:10.079402 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-b4649517-9859-4bd7-9fb9-c23dd4ee1e95 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.165566 Jun 22 18:54:10.080005 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 628/1310] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:09 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:11.096465 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-bd043cc9-dd36-4b7b-b4cf-14f757cb3f66 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:11.097052 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-bd043cc9-dd36-4b7b-b4cf-14f757cb3f66 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:11.103638 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd043cc9-dd36-4b7b-b4cf-14f757cb3f66 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:11.104123 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd043cc9-dd36-4b7b-b4cf-14f757cb3f66 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:11.104903 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd043cc9-dd36-4b7b-b4cf-14f757cb3f66 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:11.105342 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-bd043cc9-dd36-4b7b-b4cf-14f757cb3f66 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:11.236616 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-bd043cc9-dd36-4b7b-b4cf-14f757cb3f66 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:11.244419 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-bd043cc9-dd36-4b7b-b4cf-14f757cb3f66 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.151896 Jun 22 18:54:11.245182 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 683/1311] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:11 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:12.261651 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-11ffc16a-af0a-4e79-a521-22fd0c918a96 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:12.262251 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-11ffc16a-af0a-4e79-a521-22fd0c918a96 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:12.268983 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-11ffc16a-af0a-4e79-a521-22fd0c918a96 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:12.269425 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-11ffc16a-af0a-4e79-a521-22fd0c918a96 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:12.270175 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-11ffc16a-af0a-4e79-a521-22fd0c918a96 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:12.270600 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-11ffc16a-af0a-4e79-a521-22fd0c918a96 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:12.401084 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-11ffc16a-af0a-4e79-a521-22fd0c918a96 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:12.408642 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-11ffc16a-af0a-4e79-a521-22fd0c918a96 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.151194 Jun 22 18:54:12.409208 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 629/1312] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:12 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:13.426530 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-681f3411-ee00-4308-a408-4e79a794f753 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:13.427137 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-681f3411-ee00-4308-a408-4e79a794f753 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:13.435073 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-681f3411-ee00-4308-a408-4e79a794f753 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:13.435523 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-681f3411-ee00-4308-a408-4e79a794f753 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:13.436322 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-681f3411-ee00-4308-a408-4e79a794f753 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:13.436769 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-681f3411-ee00-4308-a408-4e79a794f753 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:13.578246 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-681f3411-ee00-4308-a408-4e79a794f753 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:13.587278 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-681f3411-ee00-4308-a408-4e79a794f753 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.164034 Jun 22 18:54:13.587857 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 684/1313] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:13 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:14.604624 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e1ba9728-8da4-49cd-898c-cad7b9cf2af9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:14.605255 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e1ba9728-8da4-49cd-898c-cad7b9cf2af9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:14.611727 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e1ba9728-8da4-49cd-898c-cad7b9cf2af9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:14.612194 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e1ba9728-8da4-49cd-898c-cad7b9cf2af9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:14.612942 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e1ba9728-8da4-49cd-898c-cad7b9cf2af9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:14.613368 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e1ba9728-8da4-49cd-898c-cad7b9cf2af9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:14.743640 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e1ba9728-8da4-49cd-898c-cad7b9cf2af9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:14.751117 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e1ba9728-8da4-49cd-898c-cad7b9cf2af9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1508 microversion: 2.1 time: 0.150455 Jun 22 18:54:14.751685 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 630/1314] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:14 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:14.768099 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-e771661d-2fb2-415f-8575-a7dfbbb22e8b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:54:14.768757 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-e771661d-2fb2-415f-8575-a7dfbbb22e8b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:14.775765 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e771661d-2fb2-415f-8575-a7dfbbb22e8b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:14.776244 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e771661d-2fb2-415f-8575-a7dfbbb22e8b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:14.777002 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e771661d-2fb2-415f-8575-a7dfbbb22e8b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:14.777432 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-e771661d-2fb2-415f-8575-a7dfbbb22e8b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:14.865325 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e771661d-2fb2-415f-8575-a7dfbbb22e8b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [8f235eb4-f509-4b03-a645-78122cab0e17] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 18:54:15.236277 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-c333bf79-c6f4-47a8-a87f-815438437d6a req-e64fa215-7d5b-4580-91f8-180e7b2dcf9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1480f2-347e-427e-973a-273c41839863", "name": "network-vif-unplugged", "status": "completed", "tag": "826cbcec-8cca-4af8-aaf9-db06515201a3"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:54:15.245606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-c333bf79-c6f4-47a8-a87f-815438437d6a req-e64fa215-7d5b-4580-91f8-180e7b2dcf9d service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:15.246131 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-c333bf79-c6f4-47a8-a87f-815438437d6a req-e64fa215-7d5b-4580-91f8-180e7b2dcf9d service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:15.260315 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.compute.server_external_events [req-c333bf79-c6f4-47a8-a87f-815438437d6a req-e64fa215-7d5b-4580-91f8-180e7b2dcf9d service nova] Unable to find a host for instance 7b1480f2-347e-427e-973a-273c41839863. Dropping event network-vif-unplugged {{(pid=129743) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 18:54:15.261292 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-c333bf79-c6f4-47a8-a87f-815438437d6a req-e64fa215-7d5b-4580-91f8-180e7b2dcf9d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028924 Jun 22 18:54:15.261908 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 631/1315] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 22 18:54:15.872904 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO oslo.messaging._drivers.impl_rabbit [None req-e771661d-2fb2-415f-8575-a7dfbbb22e8b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [8f235eb4-f509-4b03-a645-78122cab0e17] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56328. Jun 22 18:54:15.875998 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-e771661d-2fb2-415f-8575-a7dfbbb22e8b tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "POST /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863/action" status: 202 len: 0 microversion: 2.1 time: 1.111938 Jun 22 18:54:15.876605 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 685/1316] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:54:14 2022] POST /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863/action => generated 0 bytes in 1113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:54:15.884917 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c26f0b0f-a9ef-4d97-ac1f-1e47b867c76c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:15.885531 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c26f0b0f-a9ef-4d97-ac1f-1e47b867c76c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:15.891745 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c26f0b0f-a9ef-4d97-ac1f-1e47b867c76c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:15.892218 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c26f0b0f-a9ef-4d97-ac1f-1e47b867c76c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:15.892990 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c26f0b0f-a9ef-4d97-ac1f-1e47b867c76c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:15.893429 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c26f0b0f-a9ef-4d97-ac1f-1e47b867c76c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:16.044290 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c26f0b0f-a9ef-4d97-ac1f-1e47b867c76c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:16.051770 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c26f0b0f-a9ef-4d97-ac1f-1e47b867c76c tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1516 microversion: 2.1 time: 0.170992 Jun 22 18:54:16.052399 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 632/1317] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:15 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:17.069988 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-31a65bdb-9e7d-4162-9e8b-5b51f3e3c2b2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:17.070544 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-31a65bdb-9e7d-4162-9e8b-5b51f3e3c2b2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:17.078257 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-31a65bdb-9e7d-4162-9e8b-5b51f3e3c2b2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:17.078701 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-31a65bdb-9e7d-4162-9e8b-5b51f3e3c2b2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:17.080727 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-31a65bdb-9e7d-4162-9e8b-5b51f3e3c2b2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:17.081166 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-31a65bdb-9e7d-4162-9e8b-5b51f3e3c2b2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:17.225650 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-31a65bdb-9e7d-4162-9e8b-5b51f3e3c2b2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:17.233823 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-31a65bdb-9e7d-4162-9e8b-5b51f3e3c2b2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1518 microversion: 2.1 time: 0.168460 Jun 22 18:54:17.234473 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 686/1318] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:17 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:18.251612 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e5dc88e7-7ede-4633-bf70-b8f336d1e8ef tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:18.252179 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e5dc88e7-7ede-4633-bf70-b8f336d1e8ef tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:18.259585 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e5dc88e7-7ede-4633-bf70-b8f336d1e8ef tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:18.260056 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e5dc88e7-7ede-4633-bf70-b8f336d1e8ef tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:18.260813 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e5dc88e7-7ede-4633-bf70-b8f336d1e8ef tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:18.261246 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e5dc88e7-7ede-4633-bf70-b8f336d1e8ef tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:18.400359 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e5dc88e7-7ede-4633-bf70-b8f336d1e8ef tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:18.407848 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e5dc88e7-7ede-4633-bf70-b8f336d1e8ef tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1574 microversion: 2.1 time: 0.160155 Jun 22 18:54:18.408421 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 633/1319] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:18 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:19.425045 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-88a6a342-7b4e-4134-a063-cc8256e8ee30 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:19.425660 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-88a6a342-7b4e-4134-a063-cc8256e8ee30 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:19.433067 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-88a6a342-7b4e-4134-a063-cc8256e8ee30 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:19.433525 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-88a6a342-7b4e-4134-a063-cc8256e8ee30 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:19.434286 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-88a6a342-7b4e-4134-a063-cc8256e8ee30 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:19.434717 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-88a6a342-7b4e-4134-a063-cc8256e8ee30 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:19.564833 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-88a6a342-7b4e-4134-a063-cc8256e8ee30 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:19.572622 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-88a6a342-7b4e-4134-a063-cc8256e8ee30 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1574 microversion: 2.1 time: 0.151418 Jun 22 18:54:19.573182 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 687/1320] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:19 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:20.589827 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-ec92e853-4673-476e-8f23-cd4043a841d9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:20.590428 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-ec92e853-4673-476e-8f23-cd4043a841d9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:20.596859 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ec92e853-4673-476e-8f23-cd4043a841d9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:20.597303 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ec92e853-4673-476e-8f23-cd4043a841d9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:20.598059 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ec92e853-4673-476e-8f23-cd4043a841d9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:20.598487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-ec92e853-4673-476e-8f23-cd4043a841d9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:20.726475 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-ec92e853-4673-476e-8f23-cd4043a841d9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:20.734596 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-ec92e853-4673-476e-8f23-cd4043a841d9 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1574 microversion: 2.1 time: 0.149062 Jun 22 18:54:20.735159 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 634/1321] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:20 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:21.751517 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-042f173c-ec4b-4599-a97d-9e6440627b67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:21.752093 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-042f173c-ec4b-4599-a97d-9e6440627b67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:21.759657 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-042f173c-ec4b-4599-a97d-9e6440627b67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:21.760142 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-042f173c-ec4b-4599-a97d-9e6440627b67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:21.760924 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-042f173c-ec4b-4599-a97d-9e6440627b67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:21.761360 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-042f173c-ec4b-4599-a97d-9e6440627b67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:21.891581 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-042f173c-ec4b-4599-a97d-9e6440627b67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:21.899563 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-042f173c-ec4b-4599-a97d-9e6440627b67 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1574 microversion: 2.1 time: 0.151521 Jun 22 18:54:21.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 688/1322] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:21 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:22.916194 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c7507b42-2209-4123-b5a3-e4bf8044f9db tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:22.916741 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c7507b42-2209-4123-b5a3-e4bf8044f9db tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:22.924003 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c7507b42-2209-4123-b5a3-e4bf8044f9db tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:22.924447 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c7507b42-2209-4123-b5a3-e4bf8044f9db tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:22.925200 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c7507b42-2209-4123-b5a3-e4bf8044f9db tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:22.925626 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c7507b42-2209-4123-b5a3-e4bf8044f9db tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:23.054043 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c7507b42-2209-4123-b5a3-e4bf8044f9db tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:23.061476 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c7507b42-2209-4123-b5a3-e4bf8044f9db tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1574 microversion: 2.1 time: 0.149296 Jun 22 18:54:23.062071 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 635/1323] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:22 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:24.079069 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-10d6301f-eb4e-4bea-a669-7347c6d03106 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:24.079613 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-10d6301f-eb4e-4bea-a669-7347c6d03106 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:24.085674 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-10d6301f-eb4e-4bea-a669-7347c6d03106 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:24.086116 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-10d6301f-eb4e-4bea-a669-7347c6d03106 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:24.087189 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-10d6301f-eb4e-4bea-a669-7347c6d03106 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:24.087619 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-10d6301f-eb4e-4bea-a669-7347c6d03106 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:24.105888 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:54:24.217344 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-10d6301f-eb4e-4bea-a669-7347c6d03106 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:24.225380 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-10d6301f-eb4e-4bea-a669-7347c6d03106 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1574 microversion: 2.1 time: 0.150258 Jun 22 18:54:24.226446 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 689/1324] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:24 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:25.244854 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-a779f2a1-9371-43d6-9e7b-00ed29b3c344 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:25.245408 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-a779f2a1-9371-43d6-9e7b-00ed29b3c344 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:25.251976 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a779f2a1-9371-43d6-9e7b-00ed29b3c344 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:25.252426 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a779f2a1-9371-43d6-9e7b-00ed29b3c344 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:25.253184 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a779f2a1-9371-43d6-9e7b-00ed29b3c344 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:25.253613 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-a779f2a1-9371-43d6-9e7b-00ed29b3c344 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:25.394530 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-a779f2a1-9371-43d6-9e7b-00ed29b3c344 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:25.401968 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-a779f2a1-9371-43d6-9e7b-00ed29b3c344 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1574 microversion: 2.1 time: 0.161993 Jun 22 18:54:25.402537 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 636/1325] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:25 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:26.418631 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-c14b04a8-dc6c-43f0-87b5-63bc19648936 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:26.419260 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-c14b04a8-dc6c-43f0-87b5-63bc19648936 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:26.421748 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=31 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:54:26.427289 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c14b04a8-dc6c-43f0-87b5-63bc19648936 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:26.427729 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c14b04a8-dc6c-43f0-87b5-63bc19648936 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:26.428507 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c14b04a8-dc6c-43f0-87b5-63bc19648936 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:26.428935 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-c14b04a8-dc6c-43f0-87b5-63bc19648936 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:26.564849 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-c14b04a8-dc6c-43f0-87b5-63bc19648936 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:26.573031 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-c14b04a8-dc6c-43f0-87b5-63bc19648936 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1574 microversion: 2.1 time: 0.158466 Jun 22 18:54:26.573587 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 690/1326] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:26 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:27.590634 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-e7129968-9d61-4fe7-b1d1-be79b07de9e4 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:27.591267 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-e7129968-9d61-4fe7-b1d1-be79b07de9e4 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:27.593658 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=31 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:54:27.598877 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e7129968-9d61-4fe7-b1d1-be79b07de9e4 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:27.599319 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e7129968-9d61-4fe7-b1d1-be79b07de9e4 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:27.600105 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e7129968-9d61-4fe7-b1d1-be79b07de9e4 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:27.600535 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-e7129968-9d61-4fe7-b1d1-be79b07de9e4 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:27.605912 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=87 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:54:27.733062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-e7129968-9d61-4fe7-b1d1-be79b07de9e4 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:27.740788 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-e7129968-9d61-4fe7-b1d1-be79b07de9e4 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1574 microversion: 2.1 time: 0.155112 Jun 22 18:54:27.741565 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 637/1327] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:27 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:28.757846 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0a9067c5-5505-4fec-94dc-497306ac7d5f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:28.758747 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0a9067c5-5505-4fec-94dc-497306ac7d5f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:28.765352 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0a9067c5-5505-4fec-94dc-497306ac7d5f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:28.765798 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0a9067c5-5505-4fec-94dc-497306ac7d5f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:28.766550 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0a9067c5-5505-4fec-94dc-497306ac7d5f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:28.766977 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0a9067c5-5505-4fec-94dc-497306ac7d5f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:28.896873 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-0a9067c5-5505-4fec-94dc-497306ac7d5f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:28.904898 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0a9067c5-5505-4fec-94dc-497306ac7d5f tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1574 microversion: 2.1 time: 0.150914 Jun 22 18:54:28.905769 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 691/1328] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:28 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:29.282995 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-ac2222e6-25f4-41ae-8b90-5388de3b6f72 req-1070919c-444c-4ce3-9ef5-42f9142e7351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1480f2-347e-427e-973a-273c41839863", "name": "network-vif-plugged", "status": "completed", "tag": "826cbcec-8cca-4af8-aaf9-db06515201a3"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:54:29.291180 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-ac2222e6-25f4-41ae-8b90-5388de3b6f72 req-1070919c-444c-4ce3-9ef5-42f9142e7351 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:29.291635 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-ac2222e6-25f4-41ae-8b90-5388de3b6f72 req-1070919c-444c-4ce3-9ef5-42f9142e7351 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:29.302725 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-ac2222e6-25f4-41ae-8b90-5388de3b6f72 req-1070919c-444c-4ce3-9ef5-42f9142e7351 service nova] Creating event network-vif-plugged:826cbcec-8cca-4af8-aaf9-db06515201a3 for instance 7b1480f2-347e-427e-973a-273c41839863 on hv-cinder-81268 Jun 22 18:54:29.308021 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-ac2222e6-25f4-41ae-8b90-5388de3b6f72 req-1070919c-444c-4ce3-9ef5-42f9142e7351 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028625 Jun 22 18:54:29.308631 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 638/1329] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:54:29.922805 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-f8e34590-81a7-47a8-96e2-ee38b809a5ba tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:29.923410 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-f8e34590-81a7-47a8-96e2-ee38b809a5ba tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:29.930577 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f8e34590-81a7-47a8-96e2-ee38b809a5ba tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:29.931027 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f8e34590-81a7-47a8-96e2-ee38b809a5ba tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:29.931819 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f8e34590-81a7-47a8-96e2-ee38b809a5ba tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:29.932274 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-f8e34590-81a7-47a8-96e2-ee38b809a5ba tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:30.065188 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-f8e34590-81a7-47a8-96e2-ee38b809a5ba tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:30.072937 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-f8e34590-81a7-47a8-96e2-ee38b809a5ba tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1574 microversion: 2.1 time: 0.154047 Jun 22 18:54:30.073498 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 692/1330] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:29 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:31.090828 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-5b3f4ea1-4f16-4161-90d0-5c397497e0ab tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:31.091529 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-5b3f4ea1-4f16-4161-90d0-5c397497e0ab tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:31.097924 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5b3f4ea1-4f16-4161-90d0-5c397497e0ab tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:31.098430 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5b3f4ea1-4f16-4161-90d0-5c397497e0ab tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:31.099269 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5b3f4ea1-4f16-4161-90d0-5c397497e0ab tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:31.099710 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-5b3f4ea1-4f16-4161-90d0-5c397497e0ab tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:31.236226 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-5b3f4ea1-4f16-4161-90d0-5c397497e0ab tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:31.244819 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-5b3f4ea1-4f16-4161-90d0-5c397497e0ab tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1561 microversion: 2.1 time: 0.158800 Jun 22 18:54:31.245377 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 639/1331] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:31 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:37.708678 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-43b86450-02c7-4576-8c8e-1fb0096097cc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-319233564"}} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:54:37.709233 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-43b86450-02c7-4576-8c8e-1fb0096097cc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:37.716452 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43b86450-02c7-4576-8c8e-1fb0096097cc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:37.716907 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43b86450-02c7-4576-8c8e-1fb0096097cc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:37.717672 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43b86450-02c7-4576-8c8e-1fb0096097cc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:37.718109 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-43b86450-02c7-4576-8c8e-1fb0096097cc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:37.843635 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.network.security_group_api [None req-43b86450-02c7-4576-8c8e-1fb0096097cc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Removing security group 508a1aa8-2027-4d97-8c78-4a87ad8066df from port 1c2aaafb-4ce0-4795-b06a-4cff3a62556e Jun 22 18:54:38.170251 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-43b86450-02c7-4576-8c8e-1fb0096097cc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "POST /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/action" status: 202 len: 0 microversion: 2.1 time: 0.465583 Jun 22 18:54:38.174230 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 693/1332] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 22 18:54:37 2022] POST /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:54:38.256103 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-bb6a1928-fa5d-4ef7-ac5e-c651a7ed2e28 req-686ee7ad-6c65-4929-9930-5cef2d2a7a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86e86e1-908c-41fd-a29f-2c257cc62df3", "tag": "1c2aaafb-4ce0-4795-b06a-4cff3a62556e"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:54:38.265991 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-bb6a1928-fa5d-4ef7-ac5e-c651a7ed2e28 req-686ee7ad-6c65-4929-9930-5cef2d2a7a06 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:38.266647 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-bb6a1928-fa5d-4ef7-ac5e-c651a7ed2e28 req-686ee7ad-6c65-4929-9930-5cef2d2a7a06 service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:38.279056 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-bb6a1928-fa5d-4ef7-ac5e-c651a7ed2e28 req-686ee7ad-6c65-4929-9930-5cef2d2a7a06 service nova] Creating event network-changed:1c2aaafb-4ce0-4795-b06a-4cff3a62556e for instance f86e86e1-908c-41fd-a29f-2c257cc62df3 on hv-cinder-81268 Jun 22 18:54:38.285263 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-bb6a1928-fa5d-4ef7-ac5e-c651a7ed2e28 req-686ee7ad-6c65-4929-9930-5cef2d2a7a06 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110263 Jun 22 18:54:38.286129 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 640/1333] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:54:39.523117 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-da5122ae-983c-4b3e-b86b-855675f45a97 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:39.523683 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-da5122ae-983c-4b3e-b86b-855675f45a97 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:39.529802 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-da5122ae-983c-4b3e-b86b-855675f45a97 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:39.530249 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-da5122ae-983c-4b3e-b86b-855675f45a97 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:39.531005 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-da5122ae-983c-4b3e-b86b-855675f45a97 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:39.531434 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-da5122ae-983c-4b3e-b86b-855675f45a97 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:39.613582 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.objects.instance [None req-da5122ae-983c-4b3e-b86b-855675f45a97 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lazy-loading 'services' on Instance uuid f86e86e1-908c-41fd-a29f-2c257cc62df3 {{(pid=129744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 18:54:39.690750 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-da5122ae-983c-4b3e-b86b-855675f45a97 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/os-volume_attachments/a8a65262-9160-4a88-bf5d-2aa7392c8839" status: 202 len: 0 microversion: 2.1 time: 0.171975 Jun 22 18:54:39.691947 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 694/1334] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 18:54:39 2022] DELETE /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/os-volume_attachments/a8a65262-9160-4a88-bf5d-2aa7392c8839 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:54:39.701667 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-2a772b51-bc13-4c06-8c45-6decac81c4f1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:39.702680 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-2a772b51-bc13-4c06-8c45-6decac81c4f1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:39.709271 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2a772b51-bc13-4c06-8c45-6decac81c4f1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:39.709731 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2a772b51-bc13-4c06-8c45-6decac81c4f1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:39.710521 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2a772b51-bc13-4c06-8c45-6decac81c4f1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:39.711010 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-2a772b51-bc13-4c06-8c45-6decac81c4f1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:39.741707 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-2a772b51-bc13-4c06-8c45-6decac81c4f1 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Jun 22 18:54:39.743602 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 641/1335] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:54:39 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:54:40.303736 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-e4bfbb0f-979b-491b-9feb-b6e6b858de75 req-1dfc27b4-2c7f-4b0f-99df-e4a4c9350d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86e86e1-908c-41fd-a29f-2c257cc62df3", "tag": "1c2aaafb-4ce0-4795-b06a-4cff3a62556e"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:54:40.312639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-e4bfbb0f-979b-491b-9feb-b6e6b858de75 req-1dfc27b4-2c7f-4b0f-99df-e4a4c9350d9e service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:40.313160 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-e4bfbb0f-979b-491b-9feb-b6e6b858de75 req-1dfc27b4-2c7f-4b0f-99df-e4a4c9350d9e service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:40.325541 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-e4bfbb0f-979b-491b-9feb-b6e6b858de75 req-1dfc27b4-2c7f-4b0f-99df-e4a4c9350d9e service nova] Creating event network-changed:1c2aaafb-4ce0-4795-b06a-4cff3a62556e for instance f86e86e1-908c-41fd-a29f-2c257cc62df3 on hv-cinder-81268 Jun 22 18:54:40.330518 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-e4bfbb0f-979b-491b-9feb-b6e6b858de75 req-1dfc27b4-2c7f-4b0f-99df-e4a4c9350d9e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031039 Jun 22 18:54:40.331183 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 695/1336] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:54:40.756456 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7348f3da-5576-4a61-baba-9d6bedbdf9bc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:40.758593 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-7348f3da-5576-4a61-baba-9d6bedbdf9bc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:40.764797 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7348f3da-5576-4a61-baba-9d6bedbdf9bc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:40.765276 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7348f3da-5576-4a61-baba-9d6bedbdf9bc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:40.766105 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7348f3da-5576-4a61-baba-9d6bedbdf9bc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:40.767075 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-7348f3da-5576-4a61-baba-9d6bedbdf9bc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:40.796330 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7348f3da-5576-4a61-baba-9d6bedbdf9bc tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046170 Jun 22 18:54:40.796895 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 642/1337] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 22 18:54:40 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 18:54:40.809367 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0c58df48-e909-4b04-b6f9-d6940d9740bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:40.809931 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0c58df48-e909-4b04-b6f9-d6940d9740bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:40.816184 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0c58df48-e909-4b04-b6f9-d6940d9740bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:40.816639 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0c58df48-e909-4b04-b6f9-d6940d9740bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:40.817563 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0c58df48-e909-4b04-b6f9-d6940d9740bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:40.818010 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0c58df48-e909-4b04-b6f9-d6940d9740bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:40.897186 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-0c58df48-e909-4b04-b6f9-d6940d9740bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] HTTP exception thrown: Instance f86e86e1-908c-41fd-a29f-2c257cc62df3 is not attached to volume a8a65262-9160-4a88-bf5d-2aa7392c8839 Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0c58df48-e909-4b04-b6f9-d6940d9740bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Request method failure captured: Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: DELETE /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/os-volume_attachments/a8a65262-9160-4a88-bf5d-2aa7392c8839 HTTP/1.1 Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2StPrTbwQR2OCXTaVtnfDpoozx02imcDeeEvnH3wSSrtTLdYz3BOrxheaVDWrGpF2xsYON3PzyzKJA7rfXmRNPg8icMJ0M5uDfebAxzyV7xSbZFjIuKRBeLbX7147P9toqvqrWNa3QnNc0qX5rSfNNdlaDUCPM87Yh4J4FKtF2GsB8 Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 6be45c6791274b4c9f58753498a1684d Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-TestMinimumBasicScenario-1766454777 Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:54:40.900162 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:54:40.901966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6be45c6791274b4c9f58753498a1684d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6be45c6791274b4c9f58753498a1684d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6be45c6791274b4c9f58753498a1684d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6be45c6791274b4c9f58753498a1684d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:54:40.901966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-TestMinimumBasicScenario-1766454777 Jun 22 18:54:40.901966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 6be45c6791274b4c9f58753498a1684d Jun 22 18:54:40.901966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766454777 Jun 22 18:54:40.901966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-TestMinimumBasicScenario-1766454777-project Jun 22 18:54:40.901966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:54:40.901966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:54:40.901966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: b183452d65b94bb0b0ce507cc9db4d08 Jun 22 18:54:40.901966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-TestMinimumBasicScenario-1766454777-project Jun 22 18:54:40.901966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:54:40.901966 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance f86e86e1-908c-41fd-a29f-2c257cc62df3 is not attached to volume a8a65262-9160-4a88-bf5d-2aa7392c8839 Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'server_id': 'f86e86e1-908c-41fd-a29f-2c257cc62df3', 'id': 'a8a65262-9160-4a88-bf5d-2aa7392c8839'} Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a8a65262-9160-4a88-bf5d-2aa7392c8839. Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:54:40.902964 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86e86e1-908c-41fd-a29f-2c257cc62df3 is not attached to volume a8a65262-9160-4a88-bf5d-2aa7392c8839 Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86e86e1-908c-41fd-a29f-2c257cc62df3 is not attached to volume a8a65262-9160-4a88-bf5d-2aa7392c8839 Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:54:40.904401 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0c58df48-e909-4b04-b6f9-d6940d9740bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Returning 404 to user: Instance f86e86e1-908c-41fd-a29f-2c257cc62df3 is not attached to volume a8a65262-9160-4a88-bf5d-2aa7392c8839 {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:54:40.905838 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0c58df48-e909-4b04-b6f9-d6940d9740bd tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/os-volume_attachments/a8a65262-9160-4a88-bf5d-2aa7392c8839" status: 404 len: 154 microversion: 2.1 time: 0.098154 Jun 22 18:54:40.905838 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 696/1338] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 22 18:54:40 2022] DELETE /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3/os-volume_attachments/a8a65262-9160-4a88-bf5d-2aa7392c8839 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 18:54:42.042329 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-85023dc0-36d2-492b-9315-4f10e16a4597 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:42.042864 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-85023dc0-36d2-492b-9315-4f10e16a4597 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:42.048959 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-85023dc0-36d2-492b-9315-4f10e16a4597 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:42.049404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-85023dc0-36d2-492b-9315-4f10e16a4597 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:42.050151 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-85023dc0-36d2-492b-9315-4f10e16a4597 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:42.050576 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-85023dc0-36d2-492b-9315-4f10e16a4597 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:42.077468 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-85023dc0-36d2-492b-9315-4f10e16a4597 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Going to try to terminate instance {{(pid=129743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:54:42.154026 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-85023dc0-36d2-492b-9315-4f10e16a4597 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 204 len: 0 microversion: 2.1 time: 0.115418 Jun 22 18:54:42.154624 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 643/1339] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:54:42 2022] DELETE /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:54:42.163619 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-7ef40334-dbee-4d69-9761-67ebf73bea81 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:42.164396 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-7ef40334-dbee-4d69-9761-67ebf73bea81 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:42.171281 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ef40334-dbee-4d69-9761-67ebf73bea81 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:42.171724 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ef40334-dbee-4d69-9761-67ebf73bea81 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:42.172552 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ef40334-dbee-4d69-9761-67ebf73bea81 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:42.172982 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-7ef40334-dbee-4d69-9761-67ebf73bea81 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:42.305421 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-7ef40334-dbee-4d69-9761-67ebf73bea81 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:42.313182 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-7ef40334-dbee-4d69-9761-67ebf73bea81 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1554 microversion: 2.1 time: 0.153467 Jun 22 18:54:42.313745 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 697/1340] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:42 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:43.331707 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-de8d4ab3-85c9-4d80-8959-3d7d872af239 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:43.332487 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-de8d4ab3-85c9-4d80-8959-3d7d872af239 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:43.339919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de8d4ab3-85c9-4d80-8959-3d7d872af239 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:43.340369 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de8d4ab3-85c9-4d80-8959-3d7d872af239 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:43.341142 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de8d4ab3-85c9-4d80-8959-3d7d872af239 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:43.341576 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-de8d4ab3-85c9-4d80-8959-3d7d872af239 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:43.725387 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-de8d4ab3-85c9-4d80-8959-3d7d872af239 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:43.733752 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-de8d4ab3-85c9-4d80-8959-3d7d872af239 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1554 microversion: 2.1 time: 0.406283 Jun 22 18:54:43.734309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 644/1341] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:43 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1554 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:44.751168 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-749aba4f-9495-40df-a0ae-8b63d14c16c9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:44.752494 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-749aba4f-9495-40df-a0ae-8b63d14c16c9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:44.762258 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-749aba4f-9495-40df-a0ae-8b63d14c16c9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:44.762717 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-749aba4f-9495-40df-a0ae-8b63d14c16c9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:44.763501 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-749aba4f-9495-40df-a0ae-8b63d14c16c9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:44.763989 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-749aba4f-9495-40df-a0ae-8b63d14c16c9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:44.822684 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [req-8e9515fe-e537-43bf-b3f2-8575e343d242 req-debf44a8-9c66-44d7-b717-024cb1badbcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86e86e1-908c-41fd-a29f-2c257cc62df3", "name": "network-vif-deleted", "tag": "1c2aaafb-4ce0-4795-b06a-4cff3a62556e"}]} {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:54:44.831114 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-8e9515fe-e537-43bf-b3f2-8575e343d242 req-debf44a8-9c66-44d7-b717-024cb1badbcc service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:44.831938 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [req-8e9515fe-e537-43bf-b3f2-8575e343d242 req-debf44a8-9c66-44d7-b717-024cb1badbcc service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:44.843630 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-749aba4f-9495-40df-a0ae-8b63d14c16c9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b183452d65b94bb0b0ce507cc9db4d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be45c6791274b4c9f58753498a1684d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:54:44.845148 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.compute.server_external_events [req-8e9515fe-e537-43bf-b3f2-8575e343d242 req-debf44a8-9c66-44d7-b717-024cb1badbcc service nova] Creating event network-vif-deleted:1c2aaafb-4ce0-4795-b06a-4cff3a62556e for instance f86e86e1-908c-41fd-a29f-2c257cc62df3 on hv-cinder-81268 Jun 22 18:54:44.850362 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [req-8e9515fe-e537-43bf-b3f2-8575e343d242 req-debf44a8-9c66-44d7-b717-024cb1badbcc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099252 Jun 22 18:54:44.850949 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 645/1342] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:54:44.852607 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-749aba4f-9495-40df-a0ae-8b63d14c16c9 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 200 len: 1512 microversion: 2.1 time: 0.105754 Jun 22 18:54:44.853124 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 698/1343] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:44 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 1512 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:54:45.731062 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 18:54:45.731287 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Wed Jun 22 18:54:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 18:54:45.870135 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6befdb1c-b07e-4c83-b746-f7566d4f11d6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:45.870835 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-6befdb1c-b07e-4c83-b746-f7566d4f11d6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] [instance: f86e86e1-908c-41fd-a29f-2c257cc62df3] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:54:45.878434 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6befdb1c-b07e-4c83-b746-f7566d4f11d6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:45.878878 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6befdb1c-b07e-4c83-b746-f7566d4f11d6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:45.879628 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6befdb1c-b07e-4c83-b746-f7566d4f11d6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:54:45.880085 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-6befdb1c-b07e-4c83-b746-f7566d4f11d6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:54:45.893404 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.wsgi [None req-6befdb1c-b07e-4c83-b746-f7566d4f11d6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] HTTP exception thrown: Instance f86e86e1-908c-41fd-a29f-2c257cc62df3 could not be found. Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6befdb1c-b07e-4c83-b746-f7566d4f11d6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Request method failure captured: Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: request: GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 HTTP/1.1 Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept: application/json Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Accept-Encoding: identity Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Connection: close Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Length: 0 Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Content-Type: application/json Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Host: 10.222.0.18 Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Openstack-System-Scope: None Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: User-Agent: python-urllib3/1.26.9 Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Auth-Token: gAAAAABis2StPrTbwQR2OCXTaVtnfDpoozx02imcDeeEvnH3wSSrtTLdYz3BOrxheaVDWrGpF2xsYON3PzyzKJA7rfXmRNPg8icMJ0M5uDfebAxzyV7xSbZFjIuKRBeLbX7147P9toqvqrWNa3QnNc0qX5rSfNNdlaDUCPM87Yh4J4FKtF2GsB8 Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Id: None Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Domain-Name: None Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Identity-Status: Confirmed Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Is-Admin-Project: True Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Id: default Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Domain-Name: Default Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Id: 6be45c6791274b4c9f58753498a1684d Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Project-Name: tempest-TestMinimumBasicScenario-1766454777 Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Role: member,reader Jun 22 18:54:45.894998 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Roles: member,reader Jun 22 18:54:45.896817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6be45c6791274b4c9f58753498a1684d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6be45c6791274b4c9f58753498a1684d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6be45c6791274b4c9f58753498a1684d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6be45c6791274b4c9f58753498a1684d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:54:45.896817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant: tempest-TestMinimumBasicScenario-1766454777 Jun 22 18:54:45.896817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Id: 6be45c6791274b4c9f58753498a1684d Jun 22 18:54:45.896817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766454777 Jun 22 18:54:45.896817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User: tempest-TestMinimumBasicScenario-1766454777-project Jun 22 18:54:45.896817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Id: default Jun 22 18:54:45.896817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Domain-Name: Default Jun 22 18:54:45.896817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Id: b183452d65b94bb0b0ce507cc9db4d08 Jun 22 18:54:45.896817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: X-User-Name: tempest-TestMinimumBasicScenario-1766454777-project Jun 22 18:54:45.896817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: method: > Jun 22 18:54:45.896817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: exception: Instance f86e86e1-908c-41fd-a29f-2c257cc62df3 could not be found. Jun 22 18:54:45.896817 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: action_args: {'id': 'f86e86e1-908c-41fd-a29f-2c257cc62df3'} Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86e86e1-908c-41fd-a29f-2c257cc62df3 could not be found. Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:54:45.897808 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86e86e1-908c-41fd-a29f-2c257cc62df3 could not be found. Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86e86e1-908c-41fd-a29f-2c257cc62df3 could not be found. Jun 22 18:54:45.900058 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: ERROR nova.api.openstack.wsgi Jun 22 18:54:45.901677 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-6befdb1c-b07e-4c83-b746-f7566d4f11d6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Returning 404 to user: Instance f86e86e1-908c-41fd-a29f-2c257cc62df3 could not be found. {{(pid=129743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:54:45.901677 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-6befdb1c-b07e-4c83-b746-f7566d4f11d6 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3" status: 404 len: 111 microversion: 2.1 time: 0.030674 Jun 22 18:54:45.901677 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 646/1344] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:54:45 2022] GET /compute/v2.1/servers/f86e86e1-908c-41fd-a29f-2c257cc62df3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:54:45.905955 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-b60e4ebb-9193-4e73-91b1-420a45e01170 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] Calling method '.version_select at 0x7fd75614cc10>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:54:45.927446 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-b60e4ebb-9193-4e73-91b1-420a45e01170 tempest-TestMinimumBasicScenario-1766454777 tempest-TestMinimumBasicScenario-1766454777-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-889233669" status: 202 len: 0 microversion: 2.1 time: 0.025281 Jun 22 18:54:45.928031 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 699/1345] 10.222.0.18 () {58 vars in 1268 bytes} [Wed Jun 22 18:54:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-889233669 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:54:51.761309 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 18:54:51.761780 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Wed Jun 22 18:54:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 18:56:07.884916 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:56:07.886293 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG dbcounter [-] [129743] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:56:07.889316 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:56:07.890364 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG dbcounter [-] [129744] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=129744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 18:56:07.890542 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-0a8a6a97-49fe-4143-8c5b-23bcef9845cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:56:07.890987 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0a8a6a97-49fe-4143-8c5b-23bcef9845cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:56:07.895416 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-78bb395b-e339-48e7-894d-a81dc7705508 req-7aaf4af3-428b-4c01-b81a-98bbe2594d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b1480f2-347e-427e-973a-273c41839863", "tag": "826cbcec-8cca-4af8-aaf9-db06515201a3"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:56:07.898743 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0a8a6a97-49fe-4143-8c5b-23bcef9845cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:56:07.899403 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0a8a6a97-49fe-4143-8c5b-23bcef9845cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:56:07.900188 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0a8a6a97-49fe-4143-8c5b-23bcef9845cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:56:07.900784 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-0a8a6a97-49fe-4143-8c5b-23bcef9845cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:56:07.907731 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-78bb395b-e339-48e7-894d-a81dc7705508 req-7aaf4af3-428b-4c01-b81a-98bbe2594d5a service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:56:07.908217 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-78bb395b-e339-48e7-894d-a81dc7705508 req-7aaf4af3-428b-4c01-b81a-98bbe2594d5a service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:56:07.921400 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-78bb395b-e339-48e7-894d-a81dc7705508 req-7aaf4af3-428b-4c01-b81a-98bbe2594d5a service nova] Creating event network-changed:826cbcec-8cca-4af8-aaf9-db06515201a3 for instance 7b1480f2-347e-427e-973a-273c41839863 on hv-cinder-81268 Jun 22 18:56:07.926738 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-78bb395b-e339-48e7-894d-a81dc7705508 req-7aaf4af3-428b-4c01-b81a-98bbe2594d5a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040253 Jun 22 18:56:07.927490 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 700/1346] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 18:56:07.930903 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-0a8a6a97-49fe-4143-8c5b-23bcef9845cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Going to try to terminate instance {{(pid=129743) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 18:56:08.020077 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-0a8a6a97-49fe-4143-8c5b-23bcef9845cc tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 204 len: 0 microversion: 2.1 time: 0.137240 Jun 22 18:56:08.020995 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 647/1347] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 22 18:56:07 2022] DELETE /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 18:56:08.029839 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-97e8fae8-47ad-42b3-b197-fe5ee31a8d55 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:56:08.030876 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-97e8fae8-47ad-42b3-b197-fe5ee31a8d55 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:56:08.036902 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-97e8fae8-47ad-42b3-b197-fe5ee31a8d55 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:56:08.037353 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-97e8fae8-47ad-42b3-b197-fe5ee31a8d55 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:56:08.038129 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-97e8fae8-47ad-42b3-b197-fe5ee31a8d55 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:56:08.038572 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-97e8fae8-47ad-42b3-b197-fe5ee31a8d55 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:56:08.176585 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.policy [None req-97e8fae8-47ad-42b3-b197-fe5ee31a8d55 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129744) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:56:08.184527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-97e8fae8-47ad-42b3-b197-fe5ee31a8d55 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.159306 Jun 22 18:56:08.185114 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 701/1348] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:56:08 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 18:56:09.203685 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-210fdbe7-2cf5-4784-b085-3576b42f3d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:56:09.204412 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-210fdbe7-2cf5-4784-b085-3576b42f3d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:56:09.211131 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-210fdbe7-2cf5-4784-b085-3576b42f3d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:56:09.212240 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-210fdbe7-2cf5-4784-b085-3576b42f3d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:56:09.213199 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-210fdbe7-2cf5-4784-b085-3576b42f3d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:56:09.213650 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-210fdbe7-2cf5-4784-b085-3576b42f3d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:56:09.351471 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-210fdbe7-2cf5-4784-b085-3576b42f3d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:56:09.359606 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-210fdbe7-2cf5-4784-b085-3576b42f3d47 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1567 microversion: 2.1 time: 0.160767 Jun 22 18:56:09.360271 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 648/1349] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:56:09 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:56:10.134318 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [req-958a07e6-346a-4dd2-8975-cfbc4b6bd29c req-e3e4d4f2-abf3-4209-9bcd-9ec55599d41c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b1480f2-347e-427e-973a-273c41839863", "name": "network-vif-deleted", "tag": "826cbcec-8cca-4af8-aaf9-db06515201a3"}]} {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 18:56:10.143755 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-958a07e6-346a-4dd2-8975-cfbc4b6bd29c req-e3e4d4f2-abf3-4209-9bcd-9ec55599d41c service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:56:10.144241 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [req-958a07e6-346a-4dd2-8975-cfbc4b6bd29c req-e3e4d4f2-abf3-4209-9bcd-9ec55599d41c service nova] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:56:10.156196 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.compute.server_external_events [req-958a07e6-346a-4dd2-8975-cfbc4b6bd29c req-e3e4d4f2-abf3-4209-9bcd-9ec55599d41c service nova] Creating event network-vif-deleted:826cbcec-8cca-4af8-aaf9-db06515201a3 for instance 7b1480f2-347e-427e-973a-273c41839863 on hv-cinder-81268 Jun 22 18:56:10.161763 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [req-958a07e6-346a-4dd2-8975-cfbc4b6bd29c req-e3e4d4f2-abf3-4209-9bcd-9ec55599d41c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031350 Jun 22 18:56:10.162552 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 702/1350] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 22 18:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 18:56:10.376344 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-c1827195-0c7a-4e25-85f3-56094c6470cf tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:56:10.376919 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.compute.api [None req-c1827195-0c7a-4e25-85f3-56094c6470cf tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129743) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:56:10.383174 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c1827195-0c7a-4e25-85f3-56094c6470cf tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:56:10.383612 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c1827195-0c7a-4e25-85f3-56094c6470cf tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:56:10.384648 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c1827195-0c7a-4e25-85f3-56094c6470cf tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:56:10.385075 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG oslo_concurrency.lockutils [None req-c1827195-0c7a-4e25-85f3-56094c6470cf tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:56:10.451981 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.policy [None req-c1827195-0c7a-4e25-85f3-56094c6470cf tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16029fcf926c49f9b8cf10f41db61436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ccf6560673c40cb9f4acb20d10400c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129743) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 18:56:10.460903 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-c1827195-0c7a-4e25-85f3-56094c6470cf tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 200 len: 1219 microversion: 2.1 time: 0.088352 Jun 22 18:56:10.461478 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 649/1351] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:56:10 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 18:56:11.479349 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0596d137-ae38-4b0a-b13c-b13767a20fe2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '>' {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:56:11.480133 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.compute.api [None req-0596d137-ae38-4b0a-b13c-b13767a20fe2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] [instance: 7b1480f2-347e-427e-973a-273c41839863] Fetching instance by UUID {{(pid=129744) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 18:56:11.486821 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0596d137-ae38-4b0a-b13c-b13767a20fe2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:56:11.487280 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0596d137-ae38-4b0a-b13c-b13767a20fe2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:56:11.488075 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0596d137-ae38-4b0a-b13c-b13767a20fe2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 18:56:11.488537 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG oslo_concurrency.lockutils [None req-0596d137-ae38-4b0a-b13c-b13767a20fe2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Lock "a31ed574-36eb-4581-9846-6247202b74dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 18:56:11.502571 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.wsgi [None req-0596d137-ae38-4b0a-b13c-b13767a20fe2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] HTTP exception thrown: Instance 7b1480f2-347e-427e-973a-273c41839863 could not be found. Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0596d137-ae38-4b0a-b13c-b13767a20fe2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Request method failure captured: Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: request: GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 HTTP/1.1 Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept: application/json Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Accept-Encoding: identity Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Connection: close Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Length: 0 Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Content-Type: application/json Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Host: 10.222.0.18 Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Openstack-System-Scope: None Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: User-Agent: python-urllib3/1.26.9 Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Auth-Token: gAAAAABis2Ro7Shr4B94baKTJ2ncS0VTZtCmy_axlMt778KNVCdxRE-HjF3y9gk5Q5jKrHUKOvfA6k5UY2ktJV2vvhZzsMZLYieu7k2_lGOWZovAL0eDatK_8oSmNYsQT4doMcnv6g16J8u2ay6swZhvCKl_5E2m9lqkAW3zW4RWaTVLnCc3D6E Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Id: None Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Domain-Name: None Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Identity-Status: Confirmed Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Is-Admin-Project: True Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Id: default Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Domain-Name: Default Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Id: 5ccf6560673c40cb9f4acb20d10400c6 Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Project-Name: tempest-TestShelveInstance-1558415435 Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Role: member,reader Jun 22 18:56:11.504242 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Roles: member,reader Jun 22 18:56:11.506435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ccf6560673c40cb9f4acb20d10400c6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ccf6560673c40cb9f4acb20d10400c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ccf6560673c40cb9f4acb20d10400c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ccf6560673c40cb9f4acb20d10400c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 22 18:56:11.506435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant: tempest-TestShelveInstance-1558415435 Jun 22 18:56:11.506435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Id: 5ccf6560673c40cb9f4acb20d10400c6 Jun 22 18:56:11.506435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-Tenant-Name: tempest-TestShelveInstance-1558415435 Jun 22 18:56:11.506435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User: tempest-TestShelveInstance-1558415435-project Jun 22 18:56:11.506435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Id: default Jun 22 18:56:11.506435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Domain-Name: Default Jun 22 18:56:11.506435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Id: 16029fcf926c49f9b8cf10f41db61436 Jun 22 18:56:11.506435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: X-User-Name: tempest-TestShelveInstance-1558415435-project Jun 22 18:56:11.506435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: method: > Jun 22 18:56:11.506435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: exception: Instance 7b1480f2-347e-427e-973a-273c41839863 could not be found. Jun 22 18:56:11.506435 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: action_args: {'id': '7b1480f2-347e-427e-973a-273c41839863'} Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: {{(pid=129744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b1480f2-347e-427e-973a-273c41839863 could not be found. Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 18:56:11.507527 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b1480f2-347e-427e-973a-273c41839863 could not be found. Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b1480f2-347e-427e-973a-273c41839863 could not be found. Jun 22 18:56:11.509687 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: ERROR nova.api.openstack.wsgi Jun 22 18:56:11.511238 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: DEBUG nova.api.openstack.wsgi [None req-0596d137-ae38-4b0a-b13c-b13767a20fe2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Returning 404 to user: Instance 7b1480f2-347e-427e-973a-273c41839863 could not be found. {{(pid=129744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 18:56:11.511238 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO nova.api.openstack.requestlog [None req-0596d137-ae38-4b0a-b13c-b13767a20fe2 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863" status: 404 len: 111 microversion: 2.1 time: 0.030974 Jun 22 18:56:11.511238 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: [pid: 129744|app: 0|req: 703/1352] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 22 18:56:11 2022] GET /compute/v2.1/servers/7b1480f2-347e-427e-973a-273c41839863 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 18:56:11.671115 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: DEBUG nova.api.openstack.wsgi [None req-7486e680-11fc-4b8d-8a91-eefa408646e3 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] Calling method '.version_select at 0x7fd7556da8b0>' {{(pid=129743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 18:56:11.692840 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO nova.api.openstack.requestlog [None req-7486e680-11fc-4b8d-8a91-eefa408646e3 tempest-TestShelveInstance-1558415435 tempest-TestShelveInstance-1558415435-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1907804867" status: 202 len: 0 microversion: 2.1 time: 0.026947 Jun 22 18:56:11.693256 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: [pid: 129743|app: 0|req: 650/1353] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Jun 22 18:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1907804867 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 18:57:15.895956 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 18:57:15.896507 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Wed Jun 22 18:57:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 18:58:11.774678 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 18:58:11.775172 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Wed Jun 22 18:58:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 18:58:42.583268 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 18:58:42.584049 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Wed Jun 22 18:58:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 18:58:42.654247 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 18:58:42.654827 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Wed Jun 22 18:58:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 18:59:49.488316 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 18:59:49.489042 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Wed Jun 22 18:59:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 19:00:35.905071 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:00:35.905715 dv-cinder-812685-11-iscsi devstack@n-api.service[129744]: Wed Jun 22 19:00:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 19:01:25.743442 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:01:25.744032 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Wed Jun 22 19:01:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 19:01:31.784325 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 19:01:31.784930 dv-cinder-812685-11-iscsi devstack@n-api.service[129743]: Wed Jun 22 19:01:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!